Jul 06 16:28:10.007950 ip-10-0-138-170 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 16:28:10.427825 ip-10-0-138-170 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 16:28:10.427825 ip-10-0-138-170 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 16:28:10.427825 ip-10-0-138-170 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 16:28:10.427825 ip-10-0-138-170 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 16:28:10.427825 ip-10-0-138-170 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 16:28:10.428994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.428894    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 16:28:10.432628 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432593    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:28:10.432628 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432627    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432633    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432636    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432639    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432642    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432645    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432651    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432655    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432660    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432663    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432666    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432670    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432673    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432676    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432679    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432682    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432684    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432687    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432690    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:28:10.432735 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432692    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432695    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432698    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432700    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432703    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432706    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432708    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432721    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432724    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432727    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432730    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432732    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432735    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432737    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432740    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432744    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432747    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432750    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432753    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432755    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:28:10.433427 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432758    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432761    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432763    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432766    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432768    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432771    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432774    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432776    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432779    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432782    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432784    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432786    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432791    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432793    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432797    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432800    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432805    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432809    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432812    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:28:10.434176 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432815    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432818    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432821    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432824    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432827    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432830    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432833    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432835    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432838    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432841    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432844    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432846    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432849    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432851    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432854    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432856    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432859    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432862    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432864    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432867    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:28:10.434889 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432869    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432874    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432878    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432880    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432883    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432886    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432888    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432892    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432894    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432897    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432900    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432902    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432905    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432907    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432910    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432913    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432915    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432918    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432920    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:28:10.435627 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.432923    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433678    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433686    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433689    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433692    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433695    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433697    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433700    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433703    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433706    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433709    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433712    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433714    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433717    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433720    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433731    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433734    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433737    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433740    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433743    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:28:10.436320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433746    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433749    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433752    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433754    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433757    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433759    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433762    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433765    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433768    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433771    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433773    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433776    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433778    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433781    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433784    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433786    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433788    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433791    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433793    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433796    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:28:10.437183 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433799    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433801    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433804    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433807    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433811    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433814    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433817    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433820    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433824    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433827    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433831    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433833    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433837    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433840    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433843    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433846    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433848    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433851    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433854    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:28:10.437924 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433856    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433859    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433861    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433864    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433867    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433869    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433872    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433875    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433877    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433880    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433883    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433886    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433888    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433892    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433894    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433897    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433900    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433902    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433905    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433909    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:28:10.438615 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433913    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433916    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433920    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433923    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433926    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433929    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433932    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433934    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433937    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433940    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433943    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433945    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433948    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433952    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433955    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433958    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433961    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433963    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433966    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:28:10.439346 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433969    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.433972    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434393    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434398    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434403    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434407    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434410    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434414    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434417    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434420    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434423    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434426    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434429    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434432    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434434    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434437    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434440    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434443    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434446    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:28:10.440052 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434449    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434451    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434454    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434457    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434460    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434462    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434465    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434467    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434471    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434474    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434477    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434479    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434482    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434484    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434487    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434489    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434492    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434494    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434497    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434500    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:28:10.440760 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434503    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434505    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434508    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434510    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434513    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434515    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434518    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434520    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434523    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434527    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434529    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434532    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434535    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434537    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434541    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434544    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434546    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434549    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434551    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434554    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:28:10.441497 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434557    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434559    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434562    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434564    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434569    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434572    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434574    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434577    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434580    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434582    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434585    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434587    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434590    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434595    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434598    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434618    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434622    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434626    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434630    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:28:10.442225 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434634    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434636    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434639    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434643    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434646    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434650    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434652    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434655    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434658    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434660    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434663    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434665    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434668    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434671    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434673    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434676    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434678    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434681    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434684    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434686    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:28:10.442974 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434689    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434691    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.434694    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434771    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434789    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434800    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434811    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434818    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434823    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434828    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434832    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434835    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434838    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434842    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434845    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434848    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434852    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434856    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434858    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434861    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434865    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434869    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434872    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434875    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 16:28:10.443734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434878    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434882    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434886    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434889    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434892    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434896    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434900    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434903    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434906    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434909    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434912    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434916    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434919    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434922    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434928    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434932    2582 flags.go:64] FLAG: --enable-server="true"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434935    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434940    2582 flags.go:64] FLAG: --event-burst="100"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434944    2582 flags.go:64] FLAG: --event-qps="50"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434947    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434950    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434953    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434962    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434965    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434968    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 16:28:10.444600 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434971    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434975    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434978    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434981    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434984    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434987    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434990    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434994    2582 flags.go:64] FLAG: --feature-gates=""
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.434998    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435001    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435004    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435007    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435010    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435013    2582 flags.go:64] FLAG: --help="false"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435016    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435020    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435022    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435026    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435029    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435032    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435035    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435040    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435043    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 16:28:10.445537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435046    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435049    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435052    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435055    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435058    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435061    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435075    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435078    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435081    2582 flags.go:64] FLAG: --lock-file=""
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435084    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435088    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435092    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435097    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435100    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435103    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435106    2582 flags.go:64] FLAG: --logging-format="text"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435111    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435115    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435118    2582 flags.go:64] FLAG: --manifest-url=""
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435121    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435125    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435128    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435132    2582 flags.go:64] FLAG: --max-pods="110"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435136    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435139    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 16:28:10.446412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435142    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435145    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435148    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435151    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435154    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435163    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435166    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435170    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435173    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435176    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435181    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435184    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435187    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435191    2582 flags.go:64] FLAG: --port="10250"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435194    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435197    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b462066fc9d3d7c"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435200    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435203    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435212    2582 flags.go:64] FLAG: --register-node="true"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435216    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435219    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435222    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435225    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435229    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435233    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 16:28:10.447326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435236    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435240    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435243    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435245    2582 flags.go:64] FLAG: --runonce="false"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435248    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435251    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435255    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435258    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435261    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435264    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435267    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435271    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435274    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435279    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435282    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435285    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435288    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435291    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435294    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435300    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435303    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435306    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435310    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435313    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435315    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 16:28:10.448277 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435318    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435327    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435330    2582 flags.go:64] FLAG: --v="2"
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435334    2582 flags.go:64] FLAG: --version="false"
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435338    2582 flags.go:64] FLAG: --vmodule=""
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435344    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435347    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435476    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435480    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435483    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435486    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435489    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435494    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435498    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435501    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435504    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435506    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435509    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435512    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435514    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435519    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:28:10.449205 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435522    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435524    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435527    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435530    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435533    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435536    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435538    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435541    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435544    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435546    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435549    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435551    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435554    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435558    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435561    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435564    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435568    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435570    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435573    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435575    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:28:10.450011 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435578    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435580    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435583    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435586    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435588    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435591    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435593    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435596    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435598    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435613    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435616    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435620    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435623    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435626    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435629    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435631    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435634    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435637    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435639    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435642    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:28:10.450802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435645    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435648    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435651    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435654    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435656    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435659    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435662    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435665    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435669    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435672    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435675    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435677    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435680    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435683    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435685    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435688    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435690    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435693    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435696    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435698    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:28:10.451522 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435701    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435705    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435709    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435714    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435717    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435720    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435723    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435725    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435728    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435731    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435734    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435736    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435739    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435741    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435744    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435747    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435749    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435752    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435755    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435758    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:28:10.452254 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435762    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435765    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435767    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435771    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.435775    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.435808    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.442731    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.442753    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.442775    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.442781    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442842    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442847    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442851    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442854    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442856    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:28:10.453109 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442859    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442862    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442865    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442868    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442871    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442873    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442876    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442878    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442881    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442884    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442886    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442891    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442895    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442898    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442900    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442903    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442906    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442911    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442914    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:28:10.453704 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442918    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442921    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442925    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442928    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442931    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442935    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442938    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442941    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442944    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442947    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442950    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442953    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442956    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442959    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442961    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442964    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442967    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442970    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442973    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442976    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:28:10.454388 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442978    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442981    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442984    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442987    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442990    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442992    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442995    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.442998    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443001    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443003    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443006    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443009    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443012    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443015    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443018    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443020    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443023    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443026    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443030    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:28:10.455152 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443033    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443035    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443038    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443041    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443043    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443046    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443049    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443051    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443054    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443057    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443059    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443062    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443073    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443076    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443079    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443082    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443085    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443087    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443092    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:28:10.455872 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443095    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443098    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443101    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443104    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443107    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443109    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443113    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443116    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443118    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443121    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443124    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443127    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443130    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443134    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443137    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443139    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:28:10.456531 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443142    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.443147    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443271    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443276    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443280    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443282    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443286    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443289    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443292    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443294    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443298    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443301    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443303    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443306    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443309    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 16:28:10.457128 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443311    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443314    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443317    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443319    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443322    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443324    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443327    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443329    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443332    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443335    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443337    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443340    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443343    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443345    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443349    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443352    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443356    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443360    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443363    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 16:28:10.457697 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443365    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443368    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443372    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443376    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443379    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443382    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443385    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443388    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443391    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443394    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443397    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443399    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443402    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443405    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443408    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443410    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443413    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443415    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443418    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 16:28:10.458371 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443421    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443423    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443426    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443429    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443431    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443434    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443437    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443440    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443442    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443445    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443448    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443451    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443453    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443456    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443458    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443461    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443464    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443467    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443469    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 16:28:10.459059 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443472    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443474    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443477    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443479    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443482    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443484    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443487    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443490    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443492    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443494    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443497    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443500    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443503    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443505    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443508    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443511    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443513    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443516    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443518    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443522    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 16:28:10.459767 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443524    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443527    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443529    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443532    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443535    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443538    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443541    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443543    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:10.443546    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.443551    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.443709    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.445787    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.447224    2582 server.go:1019] "Starting client certificate rotation"
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.447324    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 16:28:10.460494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.447375    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 16:28:10.461073 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.449989    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 16:28:10.461073 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.454632    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 16:28:10.465228 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.465210    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 06 16:28:10.467909 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.467830    2582 log.go:25] "Validated CRI v1 image API"
Jul 06 16:28:10.469321 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.469080    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 16:28:10.471548 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.471524    2582 fs.go:135] Filesystem UUIDs: map[2723f8a7-2ef2-4a7d-b7ce-9f64879b1575:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8fdd3d9f-1922-4db1-8115-5031a72ab3ff:/dev/nvme0n1p4]
Jul 06 16:28:10.471669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.471544    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 16:28:10.477003 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.476878    2582 manager.go:216] Machine: {Timestamp:2026-07-06 16:28:10.475521896 +0000 UTC m=+0.342923114 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099166 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27bc1ecbc241eedd12fea60fb1d4b9 SystemUUID:ec27bc1e-cbc2-41ee-dd12-fea60fb1d4b9 BootID:45a3ee52-a492-4a1a-854a-39581b6b8f66 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:91:dc:b2:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:91:dc:b2:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:a1:91:8c:a8:6b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 16:28:10.477003 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.476989    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 16:28:10.477175 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.477130    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 16:28:10.480711 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.480672    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 16:28:10.480859 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.480710    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-170.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 16:28:10.481416 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.481404    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 16:28:10.481466 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.481418    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 16:28:10.481466 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.481427    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 16:28:10.482085 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.482072    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 16:28:10.482643 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.482625    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 16:28:10.483301 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.483289    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 16:28:10.486047 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486033    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 16:28:10.486179 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486169    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 16:28:10.486235 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486199    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 16:28:10.486235 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486210    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 16:28:10.486235 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486224    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 16:28:10.486235 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486234    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 06 16:28:10.486382 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486244    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 16:28:10.486669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486657    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 16:28:10.486712 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.486675    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 16:28:10.488976 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.488953    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 16:28:10.492678 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.492649    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 16:28:10.492780 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.492704    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 16:28:10.494777 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494761    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494781    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494788    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494796    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494807    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494814    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494822    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494827    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494835    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494841    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 16:28:10.494844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494849    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 16:28:10.495268 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.494855    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 16:28:10.495631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.495619    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 16:28:10.495674 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.495632    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 16:28:10.498928 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.498905    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-170.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 16:28:10.499114 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.498929    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 16:28:10.499114 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.498965    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 16:28:10.499266 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.499256    2582 server.go:1268] "Started kubelet"
Jul 06 16:28:10.499402 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.499377    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 16:28:10.499544 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.499373    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 16:28:10.499640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.499565    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 16:28:10.500338 ip-10-0-138-170 systemd[1]: Started Kubernetes Kubelet.
Jul 06 16:28:10.501286 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.501162    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 16:28:10.501682 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.501671    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 16:28:10.504962 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.504938    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 16:28:10.506914 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.506893    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 16:28:10.506914 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.506896    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 16:28:10.507080 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.507040    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:10.507574 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.507540    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 16:28:10.507890 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.507876    2582 factory.go:55] Registering systemd factory
Jul 06 16:28:10.507970 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.507894    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 06 16:28:10.508226 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508211    2582 factory.go:153] Registering CRI-O factory
Jul 06 16:28:10.508226 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508225    2582 factory.go:223] Registration of the crio container factory successfully
Jul 06 16:28:10.508354 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508290    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 16:28:10.508354 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508316    2582 factory.go:103] Registering Raw factory
Jul 06 16:28:10.508354 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508333    2582 manager.go:1196] Started watching for new ooms in manager
Jul 06 16:28:10.508684 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508670    2582 manager.go:349] Starting recovery of all containers
Jul 06 16:28:10.508907 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508892    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 16:28:10.508960 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.508912    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 16:28:10.509041 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.509029    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 16:28:10.509041 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.509041    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 16:28:10.509766 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.508046    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-170.ec2.internal.18bfc03026816993  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-170.ec2.internal,UID:ip-10-0-138-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-170.ec2.internal,},FirstTimestamp:2026-07-06 16:28:10.498984339 +0000 UTC m=+0.366385601,LastTimestamp:2026-07-06 16:28:10.498984339 +0000 UTC m=+0.366385601,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-170.ec2.internal,}"
Jul 06 16:28:10.516555 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.516517    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 16:28:10.516896 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.516850    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-170.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 16:28:10.522527 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.522508    2582 manager.go:354] Recovery completed
Jul 06 16:28:10.523957 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.523929    2582 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 16:28:10.525067 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.525046    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8jhdj"
Jul 06 16:28:10.526961 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.526949    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.528940 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.528917    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.529000 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.528948    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.529000 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.528960    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.529531 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.529514    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 16:28:10.529531 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.529528    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 16:28:10.529672 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.529545    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 16:28:10.529672 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.529528    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.530285 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.530269    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.530365 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.530296    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.530365 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.530305    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.530683 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.530669    2582 policy_none.go:49] "None policy: Start"
Jul 06 16:28:10.530683 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.530685    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 16:28:10.530785 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.530695    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 16:28:10.531923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.531910    2582 policy_none.go:47] "Start"
Jul 06 16:28:10.532586 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.530507    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-170.ec2.internal.18bfc030284a5d98  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-170.ec2.internal,UID:ip-10-0-138-170.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-170.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-170.ec2.internal,},FirstTimestamp:2026-07-06 16:28:10.528931224 +0000 UTC m=+0.396332446,LastTimestamp:2026-07-06 16:28:10.528931224 +0000 UTC m=+0.396332446,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-170.ec2.internal,}"
Jul 06 16:28:10.533074 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.533044    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8jhdj"
Jul 06 16:28:10.569247 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.569224    2582 manager.go:337] "Starting Device Plugin manager"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.569272    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.569288    2582 server.go:87] "Starting device plugin registration server"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.569627    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.569650    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.569758    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.569837    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.570038    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.570326    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 16:28:10.581685 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.570368    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:10.637734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.637688    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 16:28:10.638904 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.638885    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 16:28:10.638970 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.638925    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 16:28:10.638970 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.638949    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 16:28:10.639045 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.638990    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 16:28:10.641778 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.641753    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:28:10.669968 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.669939    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.670978 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.670963    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.671050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.670994    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.671050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.671007    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.671050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.671030    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.684241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.684182    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.684241 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.684215    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-170.ec2.internal\": node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:10.703656 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.703628    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:10.740067 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.740031    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"]
Jul 06 16:28:10.740197 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.740117    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.741065 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.741051    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.741132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.741080    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.741132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.741090    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.742377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.742363    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.742485 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.742470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.742531 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.742516    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.743137 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.743116    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.743256 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.743152    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.743256 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.743166    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.743256 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.743118    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.743256 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.743225    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.743256 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.743240    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.744323 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.744309    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.744405 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.744333    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 16:28:10.744992 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.744977    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 16:28:10.745076 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.745004    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 16:28:10.745076 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.745020    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeHasSufficientPID"
Jul 06 16:28:10.772494 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.772465    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-170.ec2.internal\" not found" node="ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.777117 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.777089    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-170.ec2.internal\" not found" node="ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.804168 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.804123    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:10.810551 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.810524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c29641176fd5d806d00b899fab6513ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal\" (UID: \"c29641176fd5d806d00b899fab6513ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.810656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.810558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29641176fd5d806d00b899fab6513ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal\" (UID: \"c29641176fd5d806d00b899fab6513ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.810656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.810576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84fd94ad0deba4a780d6c891a29cfb51-config\") pod \"kube-apiserver-proxy-ip-10-0-138-170.ec2.internal\" (UID: \"84fd94ad0deba4a780d6c891a29cfb51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.904440 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:10.904408    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:10.910858 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.910823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c29641176fd5d806d00b899fab6513ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal\" (UID: \"c29641176fd5d806d00b899fab6513ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.910944 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.910868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29641176fd5d806d00b899fab6513ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal\" (UID: \"c29641176fd5d806d00b899fab6513ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.910944 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.910914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84fd94ad0deba4a780d6c891a29cfb51-config\") pod \"kube-apiserver-proxy-ip-10-0-138-170.ec2.internal\" (UID: \"84fd94ad0deba4a780d6c891a29cfb51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.910944 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.910920    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29641176fd5d806d00b899fab6513ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal\" (UID: \"c29641176fd5d806d00b899fab6513ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.911040 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.910947    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84fd94ad0deba4a780d6c891a29cfb51-config\") pod \"kube-apiserver-proxy-ip-10-0-138-170.ec2.internal\" (UID: \"84fd94ad0deba4a780d6c891a29cfb51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:10.911040 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:10.910969    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c29641176fd5d806d00b899fab6513ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal\" (UID: \"c29641176fd5d806d00b899fab6513ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:11.005323 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:11.005246    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:11.078954 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.078916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:11.080133 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.080104    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:11.106496 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:11.106304    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:11.212160 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:11.212117    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:11.313272 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:11.313195    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:11.414305 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:11.414271    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:11.448062 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.448019    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 16:28:11.448594 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.448256    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 16:28:11.515343 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:11.515308    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-170.ec2.internal\" not found"
Jul 06 16:28:11.535832 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.535760    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 16:23:11 +0000 UTC" deadline="2027-12-23 20:49:20.384427773 +0000 UTC"
Jul 06 16:28:11.535980 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.535841    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12844h21m8.848607201s"
Jul 06 16:28:11.539232 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.539210    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:28:11.599272 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.599184    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:28:11.607178 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.607149    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:11.626115 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.626089    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 16:28:11.627213 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.627198    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal"
Jul 06 16:28:11.636280 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.636254    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 16:28:11.872334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.872311    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:28:11.963410 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:11.963369    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29641176fd5d806d00b899fab6513ea.slice/crio-c049f8cb326c41ded9ea76f6b5c322f45f84a4f4224568974dd008f2efad5a0c WatchSource:0}: Error finding container c049f8cb326c41ded9ea76f6b5c322f45f84a4f4224568974dd008f2efad5a0c: Status 404 returned error can't find the container with id c049f8cb326c41ded9ea76f6b5c322f45f84a4f4224568974dd008f2efad5a0c
Jul 06 16:28:11.963798 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:11.963774    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fd94ad0deba4a780d6c891a29cfb51.slice/crio-15cf1b8b3b9fcfcc182114955cb4ca8a69b6578ca6c090fb3c089ca8b5c94e8b WatchSource:0}: Error finding container 15cf1b8b3b9fcfcc182114955cb4ca8a69b6578ca6c090fb3c089ca8b5c94e8b: Status 404 returned error can't find the container with id 15cf1b8b3b9fcfcc182114955cb4ca8a69b6578ca6c090fb3c089ca8b5c94e8b
Jul 06 16:28:11.971021 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:11.970993    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:28:12.413041 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.413011    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 16:28:12.490364 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.490317    2582 apiserver.go:52] "Watching apiserver"
Jul 06 16:28:12.499846 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.499814    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 16:28:12.500869 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.500846    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vltrc","kube-system/konnectivity-agent-xcgvc","kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal","openshift-dns/node-resolver-lqx25","openshift-image-registry/node-ca-4nzpq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal","openshift-multus/multus-additional-cni-plugins-hnj85","openshift-multus/network-metrics-daemon-gw5p5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q","openshift-cluster-node-tuning-operator/tuned-m824p","openshift-multus/multus-czqqh","openshift-network-diagnostics/network-check-target-xlzm7","openshift-network-operator/iptables-alerter-mpdsj","openshift-ovn-kubernetes/ovnkube-node-wf2pz"]
Jul 06 16:28:12.503165 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.503146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.504400 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.504376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.505816 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.505796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.506452 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.506433    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 16:28:12.506665 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.506644    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.506912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.506897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.507224 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.507200    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 16:28:12.507610 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.507594    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 16:28:12.507705 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.507686    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p8nsr\""
Jul 06 16:28:12.508151 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.508134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.508226 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.508147    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 16:28:12.509554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.509534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:12.509649 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.509593    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:12.510898 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.510873    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.511002 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.510969    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.512030 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.511646    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vpqtm\""
Jul 06 16:28:12.512751 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.512458    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.512751 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.512533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xsz8p\""
Jul 06 16:28:12.512751 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.512559    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.512751 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.512533    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.513278 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.513259    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.513540 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.513522    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9997n\""
Jul 06 16:28:12.514269 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.513650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.514269 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.513838    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.514269 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.513743    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:12.514269 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.514069    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l5vc4\""
Jul 06 16:28:12.514269 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.514139    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 16:28:12.514598 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.514327    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6n8bf\""
Jul 06 16:28:12.514598 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.514374    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 16:28:12.514598 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.514482    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515273    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515314    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515398    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515618    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515684    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 16:28:12.515847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.515719    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.516327 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.516307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.516879 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.516672    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.517783 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.517759    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 16:28:12.518661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.518643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.521126 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.521105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.522205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:12.522277 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.522243    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:12.522452 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-system-cni-dir\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.522522 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.522522 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90baedb4-2173-4b07-b614-c3ab6b05ba95-host-slash\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.522522 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlzl9\" (UniqueName: \"kubernetes.io/projected/33df87e0-84d2-4f57-980f-065f087b20ba-kube-api-access-zlzl9\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.522656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qg4f\" (UniqueName: \"kubernetes.io/projected/2906d07c-60b9-4de3-8cce-3173f346c94f-kube-api-access-6qg4f\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.522656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.522656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.522656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q85rv\" (UniqueName: \"kubernetes.io/projected/90baedb4-2173-4b07-b614-c3ab6b05ba95-kube-api-access-q85rv\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.522656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-node-log\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.522866 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-cni-netd\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.522866 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-ovnkube-config\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.522866 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2906d07c-60b9-4de3-8cce-3173f346c94f-tmp-dir\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.522866 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-run-netns\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.522866 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-var-lib-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523122 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2906d07c-60b9-4de3-8cce-3173f346c94f-hosts-file\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.523122 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.522970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-os-release\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.523122 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-cni-bin\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523122 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-ovnkube-script-lib\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523122 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-host\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.523122 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523117    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-serviceca\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvv27\" (UniqueName: \"kubernetes.io/projected/764949f2-d89e-4ca3-83ec-78ac11ee46d9-kube-api-access-kvv27\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523183    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523193    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523210    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tgwjf\""
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-kubelet\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523326    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h6q85\""
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cnibin\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-etc-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9k8c8\""
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-ovn\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-slash\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-systemd\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33df87e0-84d2-4f57-980f-065f087b20ba-ovn-node-metrics-cert\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523586    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptts9\" (UniqueName: \"kubernetes.io/projected/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-kube-api-access-ptts9\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90baedb4-2173-4b07-b614-c3ab6b05ba95-iptables-alerter-script\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-systemd-units\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-log-socket\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-env-overrides\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.523912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.523860    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 16:28:12.553167 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.553147    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pk7vh"
Jul 06 16:28:12.567342 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.567317    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pk7vh"
Jul 06 16:28:12.609336 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.609306    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 16:28:12.625021 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.624987    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-cni-netd\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-ovnkube-config\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-run\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.625147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-cni-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.625147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-netns\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.625147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-hostroot\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.625147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-cni-netd\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-conf-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-run-netns\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-var-lib-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625274    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-run-netns\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2906d07c-60b9-4de3-8cce-3173f346c94f-hosts-file\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625368    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-var-lib-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-os-release\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.625442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-tuned\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a-agent-certs\") pod \"konnectivity-agent-xcgvc\" (UID: \"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a\") " pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-os-release\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625471    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2906d07c-60b9-4de3-8cce-3173f346c94f-hosts-file\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-cni-bin\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625528    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-cni-bin\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-os-release\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625582    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-ovnkube-config\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-registration-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cnibin\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625670    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-host\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625702    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cnibin\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltrj4\" (UniqueName: \"kubernetes.io/projected/e87ae101-9601-4da6-b562-61d9677b9ee8-kube-api-access-ltrj4\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvlvj\" (UniqueName: \"kubernetes.io/projected/655bddab-22f1-4791-978f-17fa819303af-kube-api-access-hvlvj\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:12.625857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-ovn\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625793    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-lib-modules\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-systemd\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33df87e0-84d2-4f57-980f-065f087b20ba-ovn-node-metrics-cert\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625834    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-ovn\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptts9\" (UniqueName: \"kubernetes.io/projected/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-kube-api-access-ptts9\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.625886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-systemd\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626164    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-kubernetes\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysctl-conf\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-cnibin\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-system-cni-dir\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626469    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-socket-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlzl9\" (UniqueName: \"kubernetes.io/projected/33df87e0-84d2-4f57-980f-065f087b20ba-kube-api-access-zlzl9\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.626702 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-system-cni-dir\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q85rv\" (UniqueName: \"kubernetes.io/projected/90baedb4-2173-4b07-b614-c3ab6b05ba95-kube-api-access-q85rv\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysctl-d\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-sys-fs\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-k8s-cni-cncf-io\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2906d07c-60b9-4de3-8cce-3173f346c94f-tmp-dir\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-etc-selinux\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wc8\" (UniqueName: \"kubernetes.io/projected/7da341e5-f1cb-40da-8f65-54daad7ac3de-kube-api-access-l8wc8\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysconfig\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87ae101-9601-4da6-b562-61d9677b9ee8-tmp\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-cni-multus\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-ovnkube-script-lib\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-host\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-serviceca\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvv27\" (UniqueName: \"kubernetes.io/projected/764949f2-d89e-4ca3-83ec-78ac11ee46d9-kube-api-access-kvv27\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.626988    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-host\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.627554 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-modprobe-d\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-sys\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-device-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-kubelet\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7da341e5-f1cb-40da-8f65-54daad7ac3de-cni-binary-copy\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-etc-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627183    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-kubelet\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a-konnectivity-ca\") pod \"konnectivity-agent-xcgvc\" (UID: \"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a\") " pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627182    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-run-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-socket-dir-parent\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627268    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2906d07c-60b9-4de3-8cce-3173f346c94f-tmp-dir\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-kubelet\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627203    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-etc-openvswitch\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-slash\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627383    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-serviceca\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90baedb4-2173-4b07-b614-c3ab6b05ba95-iptables-alerter-script\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627392    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-slash\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wcvb\" (UniqueName: \"kubernetes.io/projected/b6f4bfd4-5597-4989-af45-f39d93ce029c-kube-api-access-9wcvb\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-system-cni-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-daemon-config\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-etc-kubernetes\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-systemd-units\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-log-socket\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-env-overrides\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627609    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-ovnkube-script-lib\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627636    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-log-socket\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627636    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-systemd-units\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627653    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90baedb4-2173-4b07-b614-c3ab6b05ba95-host-slash\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.628994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627735    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/90baedb4-2173-4b07-b614-c3ab6b05ba95-host-slash\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40211381-eaa5-4224-907c-0d3d4acb9f35-kubelet-config\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-cni-bin\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627799    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/764949f2-d89e-4ca3-83ec-78ac11ee46d9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qg4f\" (UniqueName: \"kubernetes.io/projected/2906d07c-60b9-4de3-8cce-3173f346c94f-kube-api-access-6qg4f\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40211381-eaa5-4224-907c-0d3d4acb9f35-dbus\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-systemd\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627964    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/90baedb4-2173-4b07-b614-c3ab6b05ba95-iptables-alerter-script\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.627988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-var-lib-kubelet\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.628015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.628029    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33df87e0-84d2-4f57-980f-065f087b20ba-env-overrides\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.628038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-multus-certs\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.628065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-node-log\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.628103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33df87e0-84d2-4f57-980f-065f087b20ba-node-log\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.629496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.628319    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/764949f2-d89e-4ca3-83ec-78ac11ee46d9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.629972 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.629892    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33df87e0-84d2-4f57-980f-065f087b20ba-ovn-node-metrics-cert\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.637245 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.637215    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q85rv\" (UniqueName: \"kubernetes.io/projected/90baedb4-2173-4b07-b614-c3ab6b05ba95-kube-api-access-q85rv\") pod \"iptables-alerter-mpdsj\" (UID: \"90baedb4-2173-4b07-b614-c3ab6b05ba95\") " pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.637584 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.637550    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptts9\" (UniqueName: \"kubernetes.io/projected/bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7-kube-api-access-ptts9\") pod \"node-ca-4nzpq\" (UID: \"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7\") " pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.637771 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.637732    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvv27\" (UniqueName: \"kubernetes.io/projected/764949f2-d89e-4ca3-83ec-78ac11ee46d9-kube-api-access-kvv27\") pod \"multus-additional-cni-plugins-hnj85\" (UID: \"764949f2-d89e-4ca3-83ec-78ac11ee46d9\") " pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.639898 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.639875    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlzl9\" (UniqueName: \"kubernetes.io/projected/33df87e0-84d2-4f57-980f-065f087b20ba-kube-api-access-zlzl9\") pod \"ovnkube-node-wf2pz\" (UID: \"33df87e0-84d2-4f57-980f-065f087b20ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.639998 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.639974    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qg4f\" (UniqueName: \"kubernetes.io/projected/2906d07c-60b9-4de3-8cce-3173f346c94f-kube-api-access-6qg4f\") pod \"node-resolver-lqx25\" (UID: \"2906d07c-60b9-4de3-8cce-3173f346c94f\") " pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.643223 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.643183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal" event={"ID":"84fd94ad0deba4a780d6c891a29cfb51","Type":"ContainerStarted","Data":"15cf1b8b3b9fcfcc182114955cb4ca8a69b6578ca6c090fb3c089ca8b5c94e8b"}
Jul 06 16:28:12.644168 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.644149    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal" event={"ID":"c29641176fd5d806d00b899fab6513ea","Type":"ContainerStarted","Data":"c049f8cb326c41ded9ea76f6b5c322f45f84a4f4224568974dd008f2efad5a0c"}
Jul 06 16:28:12.728559 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:12.728559 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a-konnectivity-ca\") pod \"konnectivity-agent-xcgvc\" (UID: \"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a\") " pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.728559 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-socket-dir-parent\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728559 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-kubelet\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728559 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728563    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wcvb\" (UniqueName: \"kubernetes.io/projected/b6f4bfd4-5597-4989-af45-f39d93ce029c-kube-api-access-9wcvb\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728614    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-kubelet\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.728622    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-system-cni-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.728738    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:28:13.228689583 +0000 UTC m=+3.096090792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728737    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-socket-dir-parent\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-daemon-config\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-system-cni-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-etc-kubernetes\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40211381-eaa5-4224-907c-0d3d4acb9f35-kubelet-config\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-cni-bin\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728883    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-etc-kubernetes\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40211381-eaa5-4224-907c-0d3d4acb9f35-dbus\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-systemd\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.728938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728947    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40211381-eaa5-4224-907c-0d3d4acb9f35-kubelet-config\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-var-lib-kubelet\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728959    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-cni-bin\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.728999    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-var-lib-kubelet\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-systemd\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729087    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40211381-eaa5-4224-907c-0d3d4acb9f35-dbus\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-multus-certs\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-run\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-multus-certs\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-cni-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729231    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-netns\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729239    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-cni-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729242    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a-konnectivity-ca\") pod \"konnectivity-agent-xcgvc\" (UID: \"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a\") " pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-hostroot\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729242    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-run\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729278    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-netns\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-conf-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.729529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729306    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-hostroot\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729318    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-conf-dir\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-tuned\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a-agent-certs\") pod \"konnectivity-agent-xcgvc\" (UID: \"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a\") " pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-os-release\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729408    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7da341e5-f1cb-40da-8f65-54daad7ac3de-multus-daemon-config\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-registration-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729458    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-registration-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-host\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltrj4\" (UniqueName: \"kubernetes.io/projected/e87ae101-9601-4da6-b562-61d9677b9ee8-kube-api-access-ltrj4\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvlvj\" (UniqueName: \"kubernetes.io/projected/655bddab-22f1-4791-978f-17fa819303af-kube-api-access-hvlvj\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-host\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729551    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-os-release\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-lib-modules\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-kubernetes\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729764    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysctl-conf\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729822    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-kubernetes\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-cnibin\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729831    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-lib-modules\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.729830    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-socket-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729875    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-cnibin\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysctl-d\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.729904    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret podName:40211381-eaa5-4224-907c-0d3d4acb9f35 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:13.229886515 +0000 UTC m=+3.097287733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret") pod "global-pull-secret-syncer-vltrc" (UID: "40211381-eaa5-4224-907c-0d3d4acb9f35") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729907    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysctl-conf\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-sys-fs\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-k8s-cni-cncf-io\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729988    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-socket-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.729995    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysctl-d\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-etc-selinux\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730009    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-run-k8s-cni-cncf-io\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.730974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wc8\" (UniqueName: \"kubernetes.io/projected/7da341e5-f1cb-40da-8f65-54daad7ac3de-kube-api-access-l8wc8\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730043    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-sys-fs\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730060    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-etc-selinux\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysconfig\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87ae101-9601-4da6-b562-61d9677b9ee8-tmp\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730109    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-sysconfig\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-cni-multus\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-modprobe-d\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-sys\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-device-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730195    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7da341e5-f1cb-40da-8f65-54daad7ac3de-host-var-lib-cni-multus\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7da341e5-f1cb-40da-8f65-54daad7ac3de-cni-binary-copy\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730234    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-sys\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730252    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6f4bfd4-5597-4989-af45-f39d93ce029c-device-dir\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730373    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-modprobe-d\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.731506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.730634    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7da341e5-f1cb-40da-8f65-54daad7ac3de-cni-binary-copy\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.732233 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.732212    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e87ae101-9601-4da6-b562-61d9677b9ee8-tmp\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.732293 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.732254    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e87ae101-9601-4da6-b562-61d9677b9ee8-etc-tuned\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.732452 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.732436    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a-agent-certs\") pod \"konnectivity-agent-xcgvc\" (UID: \"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a\") " pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.740350 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.740327    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:28:12.740350 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.740349    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:28:12.740350 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.740360    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pjblw for pod openshift-network-diagnostics/network-check-target-xlzm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:12.740612 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:12.740418    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw podName:07626b4f-4641-4d31-b507-7986a9e62683 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:13.240401349 +0000 UTC m=+3.107802576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pjblw" (UniqueName: "kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw") pod "network-check-target-xlzm7" (UID: "07626b4f-4641-4d31-b507-7986a9e62683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:12.743095 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.743056    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wcvb\" (UniqueName: \"kubernetes.io/projected/b6f4bfd4-5597-4989-af45-f39d93ce029c-kube-api-access-9wcvb\") pod \"aws-ebs-csi-driver-node-z495q\" (UID: \"b6f4bfd4-5597-4989-af45-f39d93ce029c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.744341 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.744321    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wc8\" (UniqueName: \"kubernetes.io/projected/7da341e5-f1cb-40da-8f65-54daad7ac3de-kube-api-access-l8wc8\") pod \"multus-czqqh\" (UID: \"7da341e5-f1cb-40da-8f65-54daad7ac3de\") " pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.744585 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.744565    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltrj4\" (UniqueName: \"kubernetes.io/projected/e87ae101-9601-4da6-b562-61d9677b9ee8-kube-api-access-ltrj4\") pod \"tuned-m824p\" (UID: \"e87ae101-9601-4da6-b562-61d9677b9ee8\") " pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.744927 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.744909    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvlvj\" (UniqueName: \"kubernetes.io/projected/655bddab-22f1-4791-978f-17fa819303af-kube-api-access-hvlvj\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:12.816281 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.816242    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnj85"
Jul 06 16:28:12.824543 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.824513    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mpdsj"
Jul 06 16:28:12.825927 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:12.825900    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764949f2_d89e_4ca3_83ec_78ac11ee46d9.slice/crio-2c226ace3fdd92b30445d493d651a9fa7aceac79409d7e1c1c7386009fdeae16 WatchSource:0}: Error finding container 2c226ace3fdd92b30445d493d651a9fa7aceac79409d7e1c1c7386009fdeae16: Status 404 returned error can't find the container with id 2c226ace3fdd92b30445d493d651a9fa7aceac79409d7e1c1c7386009fdeae16
Jul 06 16:28:12.831324 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.831299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:12.832626 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:12.832592    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90baedb4_2173_4b07_b614_c3ab6b05ba95.slice/crio-4e0529f9458f51fd1f519cc41ca49ef0b4de8b5d616978ed5fabb60a8f3d85d8 WatchSource:0}: Error finding container 4e0529f9458f51fd1f519cc41ca49ef0b4de8b5d616978ed5fabb60a8f3d85d8: Status 404 returned error can't find the container with id 4e0529f9458f51fd1f519cc41ca49ef0b4de8b5d616978ed5fabb60a8f3d85d8
Jul 06 16:28:12.836205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.836185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lqx25"
Jul 06 16:28:12.840165 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:12.840139    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33df87e0_84d2_4f57_980f_065f087b20ba.slice/crio-3d300c17a622aef65ae9da1a4aac84db01d2cb98ee9229f1c393a6e8e0c158d8 WatchSource:0}: Error finding container 3d300c17a622aef65ae9da1a4aac84db01d2cb98ee9229f1c393a6e8e0c158d8: Status 404 returned error can't find the container with id 3d300c17a622aef65ae9da1a4aac84db01d2cb98ee9229f1c393a6e8e0c158d8
Jul 06 16:28:12.841443 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.841418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4nzpq"
Jul 06 16:28:12.844472 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:12.844443    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2906d07c_60b9_4de3_8cce_3173f346c94f.slice/crio-735c2cd9650712450795e18829e55dfb8d492f6c9ea195adbe87afc1acc2c14d WatchSource:0}: Error finding container 735c2cd9650712450795e18829e55dfb8d492f6c9ea195adbe87afc1acc2c14d: Status 404 returned error can't find the container with id 735c2cd9650712450795e18829e55dfb8d492f6c9ea195adbe87afc1acc2c14d
Jul 06 16:28:12.848310 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.848289    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q"
Jul 06 16:28:12.854479 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.854456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:12.860130 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.860103    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m824p"
Jul 06 16:28:12.865680 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:12.865236    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-czqqh"
Jul 06 16:28:12.876957 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:12.876927    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87ae101_9601_4da6_b562_61d9677b9ee8.slice/crio-9c5b4b062dbdfbf3f3f5d89dfcca45e0f81c959d389dd0ae09436de2e2115fdd WatchSource:0}: Error finding container 9c5b4b062dbdfbf3f3f5d89dfcca45e0f81c959d389dd0ae09436de2e2115fdd: Status 404 returned error can't find the container with id 9c5b4b062dbdfbf3f3f5d89dfcca45e0f81c959d389dd0ae09436de2e2115fdd
Jul 06 16:28:12.880534 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:12.880503    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da341e5_f1cb_40da_8f65_54daad7ac3de.slice/crio-ff6a62c42793254a1edb85cd8e52ca799d08892f158888fc370a03740640598d WatchSource:0}: Error finding container ff6a62c42793254a1edb85cd8e52ca799d08892f158888fc370a03740640598d: Status 404 returned error can't find the container with id ff6a62c42793254a1edb85cd8e52ca799d08892f158888fc370a03740640598d
Jul 06 16:28:13.233941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.233902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:13.234138 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.233980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:13.234212 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.234144    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:13.234267 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.234213    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:28:14.234191817 +0000 UTC m=+4.101593054 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:13.234567 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.234464    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:13.234567 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.234543    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret podName:40211381-eaa5-4224-907c-0d3d4acb9f35 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:14.234523136 +0000 UTC m=+4.101924347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret") pod "global-pull-secret-syncer-vltrc" (UID: "40211381-eaa5-4224-907c-0d3d4acb9f35") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:13.335330 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.335292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:13.335511 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.335464    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:28:13.335511 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.335493    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:28:13.335511 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.335508    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pjblw for pod openshift-network-diagnostics/network-check-target-xlzm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:13.335647 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.335571    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw podName:07626b4f-4641-4d31-b507-7986a9e62683 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:14.335553791 +0000 UTC m=+4.202955003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjblw" (UniqueName: "kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw") pod "network-check-target-xlzm7" (UID: "07626b4f-4641-4d31-b507-7986a9e62683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:13.570166 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.570036    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 16:23:13 +0000 UTC" deadline="2028-04-11 11:06:40.573656596 +0000 UTC"
Jul 06 16:28:13.570166 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.570107    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15474h38m27.003553981s"
Jul 06 16:28:13.639477 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.639443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:13.639715 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.639597    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:13.640075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.640051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:13.640179 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:13.640159    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:13.650233 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.650192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q" event={"ID":"b6f4bfd4-5597-4989-af45-f39d93ce029c","Type":"ContainerStarted","Data":"8e379824bc8a5dda19f4ac93c57d17908cf2e605ca558406383cad057feb47a7"}
Jul 06 16:28:13.653423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.653387    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4nzpq" event={"ID":"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7","Type":"ContainerStarted","Data":"59f416f5148bcb8a0292c1cab73c97e8df2ec1755f07c389d710b313f9ee6963"}
Jul 06 16:28:13.656382 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.656350    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lqx25" event={"ID":"2906d07c-60b9-4de3-8cce-3173f346c94f","Type":"ContainerStarted","Data":"735c2cd9650712450795e18829e55dfb8d492f6c9ea195adbe87afc1acc2c14d"}
Jul 06 16:28:13.658500 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.658468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"3d300c17a622aef65ae9da1a4aac84db01d2cb98ee9229f1c393a6e8e0c158d8"}
Jul 06 16:28:13.662241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.662188    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerStarted","Data":"2c226ace3fdd92b30445d493d651a9fa7aceac79409d7e1c1c7386009fdeae16"}
Jul 06 16:28:13.665061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.665029    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-czqqh" event={"ID":"7da341e5-f1cb-40da-8f65-54daad7ac3de","Type":"ContainerStarted","Data":"ff6a62c42793254a1edb85cd8e52ca799d08892f158888fc370a03740640598d"}
Jul 06 16:28:13.669455 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.669420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m824p" event={"ID":"e87ae101-9601-4da6-b562-61d9677b9ee8","Type":"ContainerStarted","Data":"9c5b4b062dbdfbf3f3f5d89dfcca45e0f81c959d389dd0ae09436de2e2115fdd"}
Jul 06 16:28:13.673608 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.673573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xcgvc" event={"ID":"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a","Type":"ContainerStarted","Data":"58796f1e3e6a04ea1b4024443d779c20ba0e16c98b622faaebe47d5f7bbd88e5"}
Jul 06 16:28:13.678103 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:13.678063    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mpdsj" event={"ID":"90baedb4-2173-4b07-b614-c3ab6b05ba95","Type":"ContainerStarted","Data":"4e0529f9458f51fd1f519cc41ca49ef0b4de8b5d616978ed5fabb60a8f3d85d8"}
Jul 06 16:28:14.247130 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:14.247085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:14.247404 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:14.247202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:14.247404 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.247346    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:14.247531 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.247414    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret podName:40211381-eaa5-4224-907c-0d3d4acb9f35 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:16.247394729 +0000 UTC m=+6.114795940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret") pod "global-pull-secret-syncer-vltrc" (UID: "40211381-eaa5-4224-907c-0d3d4acb9f35") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:14.247885 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.247863    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:14.247996 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.247926    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:28:16.247909883 +0000 UTC m=+6.115311094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:14.348498 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:14.348454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:14.348846 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.348663    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:28:14.348846 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.348685    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:28:14.348846 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.348699    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pjblw for pod openshift-network-diagnostics/network-check-target-xlzm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:14.348846 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.348763    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw podName:07626b4f-4641-4d31-b507-7986a9e62683 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:16.34874215 +0000 UTC m=+6.216143361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjblw" (UniqueName: "kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw") pod "network-check-target-xlzm7" (UID: "07626b4f-4641-4d31-b507-7986a9e62683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:14.570904 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:14.570776    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 16:23:13 +0000 UTC" deadline="2028-02-13 20:57:11.431317425 +0000 UTC"
Jul 06 16:28:14.570904 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:14.570817    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14092h28m56.860505346s"
Jul 06 16:28:14.639707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:14.639670    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:14.639906 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:14.639825    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:15.640130 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:15.640091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:15.640769 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:15.640243    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:15.640769 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:15.640656    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:15.640910 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:15.640793    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:16.265922 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:16.265876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:16.266136 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.266069    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:16.266136 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:16.266111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:16.266259 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.266152    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:28:20.266130068 +0000 UTC m=+10.133531282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:16.266259 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.266221    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:16.266391 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.266276    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret podName:40211381-eaa5-4224-907c-0d3d4acb9f35 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:20.266259999 +0000 UTC m=+10.133661225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret") pod "global-pull-secret-syncer-vltrc" (UID: "40211381-eaa5-4224-907c-0d3d4acb9f35") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:16.367089 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:16.366998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:16.367274 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.367211    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:28:16.367274 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.367239    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:28:16.367274 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.367257    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pjblw for pod openshift-network-diagnostics/network-check-target-xlzm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:16.367396 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.367332    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw podName:07626b4f-4641-4d31-b507-7986a9e62683 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:20.367308976 +0000 UTC m=+10.234710202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjblw" (UniqueName: "kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw") pod "network-check-target-xlzm7" (UID: "07626b4f-4641-4d31-b507-7986a9e62683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:16.639781 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:16.639649    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:16.639919 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:16.639788    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:17.640124 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:17.639998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:17.640124 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:17.640028    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:17.640732 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:17.640165    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:17.640732 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:17.640296    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:18.640204 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:18.640168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:18.640738 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:18.640357    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:19.640018 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:19.639979    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:19.640240 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:19.640020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:19.640240 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:19.640148    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:19.640710 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:19.640271    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:20.303938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:20.303866    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:20.304117 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:20.303948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:20.304117 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.304073    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:20.304117 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.304109    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:20.304297 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.304169    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret podName:40211381-eaa5-4224-907c-0d3d4acb9f35 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:28.304145925 +0000 UTC m=+18.171547153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret") pod "global-pull-secret-syncer-vltrc" (UID: "40211381-eaa5-4224-907c-0d3d4acb9f35") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:20.304297 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.304194    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:28:28.304181248 +0000 UTC m=+18.171582464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:20.404442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:20.404367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:20.404726 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.404583    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:28:20.404726 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.404607    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:28:20.404726 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.404635    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pjblw for pod openshift-network-diagnostics/network-check-target-xlzm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:20.404726 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.404723    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw podName:07626b4f-4641-4d31-b507-7986a9e62683 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:28.404702727 +0000 UTC m=+18.272103938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjblw" (UniqueName: "kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw") pod "network-check-target-xlzm7" (UID: "07626b4f-4641-4d31-b507-7986a9e62683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:20.641457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:20.641356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:20.641936 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:20.641479    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:21.640191 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:21.639874    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:21.640191 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:21.640015    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:21.640191 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:21.640059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:21.640191 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:21.640154    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:22.642138 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:22.642110    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:22.642568 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:22.642238    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:23.640143 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:23.639885    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:23.640304 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:23.640271    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:23.640562 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:23.639933    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:23.640562 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:23.640511    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:23.705624 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:23.705565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal" event={"ID":"84fd94ad0deba4a780d6c891a29cfb51","Type":"ContainerStarted","Data":"c94abade4bcf78260eb64193ed56692bd3b9113e94f4f6d721349d4f9125791b"}
Jul 06 16:28:23.708236 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:23.708203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m824p" event={"ID":"e87ae101-9601-4da6-b562-61d9677b9ee8","Type":"ContainerStarted","Data":"7ba1dc7b41f8e2c42c3bcf3e671c4205b2adc3c742d8e4d5f807bf7bc98454dc"}
Jul 06 16:28:23.734567 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:23.734506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-170.ec2.internal" podStartSLOduration=11.734483125 podStartE2EDuration="11.734483125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:23.7197007 +0000 UTC m=+13.587101929" watchObservedRunningTime="2026-07-06 16:28:23.734483125 +0000 UTC m=+13.601884354"
Jul 06 16:28:23.735024 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:23.735000    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m824p" podStartSLOduration=2.066480987 podStartE2EDuration="12.734994517s" totalImagesPullingTime="10.66851353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:23.733874012 +0000 UTC m=+13.601275241" watchObservedRunningTime="2026-07-06 16:28:23.734994517 +0000 UTC m=+13.602395773"
Jul 06 16:28:24.640048 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:24.639956    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:24.640209 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:24.640101    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:25.639820 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.639573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:25.640402 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.639644    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:25.640402 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:25.639945    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:25.640402 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:25.640007    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:25.713616 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.713561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mpdsj" event={"ID":"90baedb4-2173-4b07-b614-c3ab6b05ba95","Type":"ContainerStarted","Data":"014efc956693b35f8c1643b20b2126023c25db514db16ab358ab20ad3062a562"}
Jul 06 16:28:25.715231 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.715197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal" event={"ID":"c29641176fd5d806d00b899fab6513ea","Type":"ContainerStarted","Data":"74fc673b4c0dabb7e07140c687f2a0a68341881a1f633d7f7123f8e15cff84b2"}
Jul 06 16:28:25.716779 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.716750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q" event={"ID":"b6f4bfd4-5597-4989-af45-f39d93ce029c","Type":"ContainerStarted","Data":"edc8455894cd6ee57a494559dfcdd73aca1bee6cc61a3b029463971b7790e25c"}
Jul 06 16:28:25.718349 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.718316    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4nzpq" event={"ID":"bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7","Type":"ContainerStarted","Data":"657adcae329375b1943ecec50582f0d22d1d9ec51eadd780f5253fd5b13594de"}
Jul 06 16:28:25.719915 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.719888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lqx25" event={"ID":"2906d07c-60b9-4de3-8cce-3173f346c94f","Type":"ContainerStarted","Data":"7db4cf0e4f148b3d2d09013be9f62e6b237652078a544c3f28b76f1d47fd6250"}
Jul 06 16:28:25.721481 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.721451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerStarted","Data":"0aeb962fba86b76586dc2f00da166a55a733b1e63518478e3017b00c0792084f"}
Jul 06 16:28:25.722834 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.722808    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xcgvc" event={"ID":"936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a","Type":"ContainerStarted","Data":"0cbf62276e3210c5c05304c4c9348ded629f5f61d08107d43b349e06add70853"}
Jul 06 16:28:25.728539 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.728490    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mpdsj" podStartSLOduration=4.122360246 podStartE2EDuration="14.728476202s" totalImagesPullingTime="10.606115956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:25.727935561 +0000 UTC m=+15.595336801" watchObservedRunningTime="2026-07-06 16:28:25.728476202 +0000 UTC m=+15.595877430"
Jul 06 16:28:25.776994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.776916    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lqx25" podStartSLOduration=6.795812296 podStartE2EDuration="14.776897558s" totalImagesPullingTime="7.981085262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:25.776206751 +0000 UTC m=+15.643607980" watchObservedRunningTime="2026-07-06 16:28:25.776897558 +0000 UTC m=+15.644298786"
Jul 06 16:28:25.808206 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.808151    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xcgvc" podStartSLOduration=4.23692112 podStartE2EDuration="14.80813622s" totalImagesPullingTime="10.5712151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:25.808033377 +0000 UTC m=+15.675434606" watchObservedRunningTime="2026-07-06 16:28:25.80813622 +0000 UTC m=+15.675537448"
Jul 06 16:28:25.808405 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:25.808302    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4nzpq" podStartSLOduration=4.222271168 podStartE2EDuration="14.808297194s" totalImagesPullingTime="10.586026026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:25.793936786 +0000 UTC m=+15.661338015" watchObservedRunningTime="2026-07-06 16:28:25.808297194 +0000 UTC m=+15.675698421"
Jul 06 16:28:26.643280 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:26.643255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:26.643732 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:26.643363    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:26.843245 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:26.843211    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:27.639778 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:27.639639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:27.639778 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:27.639654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:27.640093 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:27.639779    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:27.640093 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:27.639867    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:27.679200 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:27.679159    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:27.680057 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:27.680034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:27.727621 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:27.727571    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xcgvc"
Jul 06 16:28:28.371541 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:28.371405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:28.371541 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:28.371518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:28.371819 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.371578    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:28.371819 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.371637    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:28.371819 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.371665    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:28:44.37164956 +0000 UTC m=+34.239050770 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 16:28:28.371819 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.371687    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret podName:40211381-eaa5-4224-907c-0d3d4acb9f35 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:44.371673012 +0000 UTC m=+34.239074219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret") pod "global-pull-secret-syncer-vltrc" (UID: "40211381-eaa5-4224-907c-0d3d4acb9f35") : object "kube-system"/"original-pull-secret" not registered
Jul 06 16:28:28.472146 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:28.472111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:28.472314 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.472268    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 16:28:28.472314 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.472290    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 16:28:28.472314 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.472302    2582 projected.go:196] Error preparing data for projected volume kube-api-access-pjblw for pod openshift-network-diagnostics/network-check-target-xlzm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:28.472469 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.472368    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw podName:07626b4f-4641-4d31-b507-7986a9e62683 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:44.472348046 +0000 UTC m=+34.339749276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pjblw" (UniqueName: "kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw") pod "network-check-target-xlzm7" (UID: "07626b4f-4641-4d31-b507-7986a9e62683") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 16:28:28.640155 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:28.640060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:28.640309 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:28.640203    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:29.639777 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.639468    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:29.639777 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.639468    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:29.640575 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:29.639837    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:29.640575 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:29.639932    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:29.733227 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.733193    2582 generic.go:356] "Generic (PLEG): container finished" podID="c29641176fd5d806d00b899fab6513ea" containerID="74fc673b4c0dabb7e07140c687f2a0a68341881a1f633d7f7123f8e15cff84b2" exitCode=0
Jul 06 16:28:29.733342 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.733269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal" event={"ID":"c29641176fd5d806d00b899fab6513ea","Type":"ContainerDied","Data":"74fc673b4c0dabb7e07140c687f2a0a68341881a1f633d7f7123f8e15cff84b2"}
Jul 06 16:28:29.737334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.737308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"70a3f2681ff0cf5e5f2364226e12c1373fb80eb7664a71e9639361ccf0acf952"}
Jul 06 16:28:29.737417 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.737395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"4fcab9d02298c0f333fcc54afb04ae607e4308fb121842631d189446a6d1beab"}
Jul 06 16:28:29.737470 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.737443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"3983db7fbfb2eed7841e5bc9b224cf5402a942773183d41d999d07ca39fdf02e"}
Jul 06 16:28:29.737528 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.737494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"3445c9398e1f3863f5c72f13029fc315ad876423b9b61f727e75b9d47e37679d"}
Jul 06 16:28:29.737576 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.737539    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"89bc925126c49446212e0dd79f91f2ae309e8f6600308ba3cf04838bc6744865"}
Jul 06 16:28:29.740348 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.740182    2582 generic.go:356] "Generic (PLEG): container finished" podID="764949f2-d89e-4ca3-83ec-78ac11ee46d9" containerID="0aeb962fba86b76586dc2f00da166a55a733b1e63518478e3017b00c0792084f" exitCode=0
Jul 06 16:28:29.740348 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.740327    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerDied","Data":"0aeb962fba86b76586dc2f00da166a55a733b1e63518478e3017b00c0792084f"}
Jul 06 16:28:29.861846 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:29.861629    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 16:28:30.581910 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.581820    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T16:28:29.86184042Z","UUID":"806b11c3-eab2-4f43-9658-eb841de9f745","Handler":null,"Name":"","Endpoint":""}
Jul 06 16:28:30.583509 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.583484    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 16:28:30.583659 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.583532    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 16:28:30.640696 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.640664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:30.641357 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:30.640767    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:30.745317 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.745277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal" event={"ID":"c29641176fd5d806d00b899fab6513ea","Type":"ContainerStarted","Data":"4e740b69dcb62c072f61e86f93c3059c1580cf951245ff6b658d0a86a857525b"}
Jul 06 16:28:30.747377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.747339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q" event={"ID":"b6f4bfd4-5597-4989-af45-f39d93ce029c","Type":"ContainerStarted","Data":"dac49912409f8a4547f0006195db38702a1b26b302ebb36e2584c71d5b76f777"}
Jul 06 16:28:30.751101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.751058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"0d1e251b62053fa28429347d5f63e63b8a7314e475230e7a585e642325b9bce8"}
Jul 06 16:28:30.760870 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:30.760810    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-170.ec2.internal" podStartSLOduration=18.760789915 podStartE2EDuration="18.760789915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:30.760468968 +0000 UTC m=+20.627870197" watchObservedRunningTime="2026-07-06 16:28:30.760789915 +0000 UTC m=+20.628191147"
Jul 06 16:28:31.639738 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:31.639710    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:31.639738 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:31.639747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:31.639974 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:31.639843    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:31.640035 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:31.640001    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:32.640060 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:32.640023    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:32.640660 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:32.640139    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:33.639990 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:33.639957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:33.640265 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:33.639957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:33.640265 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:33.640083    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:33.640265 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:33.640164    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:34.639819 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:34.639785    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:34.640000 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:34.639905    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:34.760576 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:34.760541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-czqqh" event={"ID":"7da341e5-f1cb-40da-8f65-54daad7ac3de","Type":"ContainerStarted","Data":"35e9f57d111bab8d051aa9588ad49e320ffe608306a272fb282e03e1dacbfd4e"}
Jul 06 16:28:34.762617 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:34.762573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q" event={"ID":"b6f4bfd4-5597-4989-af45-f39d93ce029c","Type":"ContainerStarted","Data":"fe9016c05331b5ae6722cc34d775589cf0810419e5b656beca31d0f934a76904"}
Jul 06 16:28:34.765556 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:34.765531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"2924a7fe42c8d39c263bf265533711b2c78019a7f1f26a4a05c187ad20e1fb6f"}
Jul 06 16:28:34.787141 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:34.787056    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-czqqh" podStartSLOduration=2.511868873 podStartE2EDuration="23.78704225s" totalImagesPullingTime="21.275173377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:34.78695357 +0000 UTC m=+24.654354797" watchObservedRunningTime="2026-07-06 16:28:34.78704225 +0000 UTC m=+24.654443477"
Jul 06 16:28:34.821535 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:34.821483    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z495q" podStartSLOduration=3.739500175 podStartE2EDuration="23.821466554s" totalImagesPullingTime="20.081966379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:34.821058215 +0000 UTC m=+24.688459446" watchObservedRunningTime="2026-07-06 16:28:34.821466554 +0000 UTC m=+24.688867782"
Jul 06 16:28:35.639417 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:35.639379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:35.639590 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:35.639491    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:35.639590 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:35.639544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:35.639696 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:35.639667    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:36.639834 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.639636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:36.640387 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:36.639927    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:36.774762 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.774726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" event={"ID":"33df87e0-84d2-4f57-980f-065f087b20ba","Type":"ContainerStarted","Data":"34237e213429ec59478a084159f7e02341be4f99636136d59c4456082ba61a48"}
Jul 06 16:28:36.774995 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.774961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:36.775103 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.775039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:36.775103 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.775087    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:36.793275 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.793245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:36.795699 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.795667    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:28:36.814589 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:36.814542    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz" podStartSLOduration=9.486820568 podStartE2EDuration="25.814525196s" totalImagesPullingTime="16.327704628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:36.813551876 +0000 UTC m=+26.680953102" watchObservedRunningTime="2026-07-06 16:28:36.814525196 +0000 UTC m=+26.681926425"
Jul 06 16:28:37.640065 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:37.640031    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:37.640571 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:37.640072    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:37.640571 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:37.640177    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:37.640571 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:37.640278    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:38.144590 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:38.144552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xlzm7"]
Jul 06 16:28:38.144756 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:38.144696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:38.144835 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:38.144809    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:38.148504 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:38.148456    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vltrc"]
Jul 06 16:28:38.148739 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:38.148569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:38.148739 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:38.148629    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gw5p5"]
Jul 06 16:28:38.149408 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:38.148690    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:38.149507 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:38.149464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:38.149993 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:38.149929    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:39.640241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:39.640037    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:39.640241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:39.640037    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:39.640724 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:39.640079    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:39.640724 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:39.640429    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:39.640724 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:39.640475    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:39.640724 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:39.640422    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:41.640072 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.640035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:41.640690 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.640035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:41.640690 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:41.640156    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vltrc" podUID="40211381-eaa5-4224-907c-0d3d4acb9f35"
Jul 06 16:28:41.640690 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.640035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:41.640690 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:41.640240    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlzm7" podUID="07626b4f-4641-4d31-b507-7986a9e62683"
Jul 06 16:28:41.640690 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:41.640325    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:28:41.785319 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.785289    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-170.ec2.internal" event="NodeReady"
Jul 06 16:28:41.785478 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.785449    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 16:28:41.788105 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.788082    2582 generic.go:356] "Generic (PLEG): container finished" podID="764949f2-d89e-4ca3-83ec-78ac11ee46d9" containerID="c468d4cc1ebea7fb0bd1b703bb5620dce563dbe497448408c2319f67ae270f8c" exitCode=0
Jul 06 16:28:41.788226 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.788127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerDied","Data":"c468d4cc1ebea7fb0bd1b703bb5620dce563dbe497448408c2319f67ae270f8c"}
Jul 06 16:28:41.827730 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.827694    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"]
Jul 06 16:28:41.851120 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.851037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b5fd5f6b8-9qf68"]
Jul 06 16:28:41.851261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.851162    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:41.853302 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.853274    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hfmwb\""
Jul 06 16:28:41.853860 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.853837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 16:28:41.854110 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.854084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 16:28:41.867084 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.867037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2znm5"]
Jul 06 16:28:41.867246 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.867161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.869476 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.869438    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 16:28:41.869476 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.869467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 16:28:41.869733 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.869563    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmcqv\""
Jul 06 16:28:41.869971 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.869950    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 16:28:41.877157 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.877126    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 16:28:41.885295 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.885263    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"]
Jul 06 16:28:41.885434 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.885306    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5s6lf"]
Jul 06 16:28:41.885434 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.885394    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:41.887645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.887599    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 16:28:41.887784 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.887658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rxcp\""
Jul 06 16:28:41.887784 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.887736    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 16:28:41.911251 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.911215    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5fd5f6b8-9qf68"]
Jul 06 16:28:41.911251 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.911256    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2znm5"]
Jul 06 16:28:41.911463 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.911281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5s6lf"]
Jul 06 16:28:41.911463 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.911364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:41.913439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.913413    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 16:28:41.913439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.913415    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 16:28:41.913651 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.913452    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tbv5p\""
Jul 06 16:28:41.913840 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.913825    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 16:28:41.971353 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:41.971353 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-image-registry-private-configuration\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16003174-93e8-4401-8713-154defaa17d7-ca-trust-extracted\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:41.971563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-trusted-ca\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-tmp-dir\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:41.971563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-installation-pull-secrets\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:41.971773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-bound-sa-token\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-config-volume\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:41.971773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjmlc\" (UniqueName: \"kubernetes.io/projected/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-kube-api-access-pjmlc\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:41.971773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l759\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-kube-api-access-5l759\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:41.971773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:41.971735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-registry-certificates\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.072828 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.072790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-trusted-ca\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.072983 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.072834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-tmp-dir\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.072983 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.072860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-installation-pull-secrets\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.072976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.073075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-bound-sa-token\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-config-volume\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.073075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjmlc\" (UniqueName: \"kubernetes.io/projected/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-kube-api-access-pjmlc\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.073075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073131    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-tmp-dir\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073206    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:42.573182396 +0000 UTC m=+32.440583624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073268    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073283    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073339    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:42.573323955 +0000 UTC m=+32.440725164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:28:42.073356 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l759\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-kube-api-access-5l759\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-registry-certificates\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc9aa07f-dbe6-4e3e-856b-10567463e5ad-cert\") pod \"ingress-canary-5s6lf\" (UID: \"cc9aa07f-dbe6-4e3e-856b-10567463e5ad\") " pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-image-registry-private-configuration\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16003174-93e8-4401-8713-154defaa17d7-ca-trust-extracted\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pft\" (UniqueName: \"kubernetes.io/projected/cc9aa07f-dbe6-4e3e-856b-10567463e5ad-kube-api-access-68pft\") pod \"ingress-canary-5s6lf\" (UID: \"cc9aa07f-dbe6-4e3e-856b-10567463e5ad\") " pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.073728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:42.074058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-config-volume\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.074058 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073824    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:28:42.074058 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.073882    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:42.573865854 +0000 UTC m=+32.441267064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:28:42.074058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073876    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-trusted-ca\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.074058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.073971    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-registry-certificates\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.074271 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.074112    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16003174-93e8-4401-8713-154defaa17d7-ca-trust-extracted\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.074271 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.074128    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:42.076865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.076842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-image-registry-private-configuration\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.076979 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.076842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-installation-pull-secrets\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.082789 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.082766    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-bound-sa-token\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.090769 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.090743    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjmlc\" (UniqueName: \"kubernetes.io/projected/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-kube-api-access-pjmlc\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.090975 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.090954    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l759\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-kube-api-access-5l759\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.174570 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.174479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc9aa07f-dbe6-4e3e-856b-10567463e5ad-cert\") pod \"ingress-canary-5s6lf\" (UID: \"cc9aa07f-dbe6-4e3e-856b-10567463e5ad\") " pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.174570 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.174546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pft\" (UniqueName: \"kubernetes.io/projected/cc9aa07f-dbe6-4e3e-856b-10567463e5ad-kube-api-access-68pft\") pod \"ingress-canary-5s6lf\" (UID: \"cc9aa07f-dbe6-4e3e-856b-10567463e5ad\") " pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.176931 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.176900    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc9aa07f-dbe6-4e3e-856b-10567463e5ad-cert\") pod \"ingress-canary-5s6lf\" (UID: \"cc9aa07f-dbe6-4e3e-856b-10567463e5ad\") " pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.182191 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.182166    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pft\" (UniqueName: \"kubernetes.io/projected/cc9aa07f-dbe6-4e3e-856b-10567463e5ad-kube-api-access-68pft\") pod \"ingress-canary-5s6lf\" (UID: \"cc9aa07f-dbe6-4e3e-856b-10567463e5ad\") " pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.220284 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.220251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5s6lf"
Jul 06 16:28:42.426454 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.426370    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5s6lf"]
Jul 06 16:28:42.429892 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:42.429862    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9aa07f_dbe6_4e3e_856b_10567463e5ad.slice/crio-cad2743b6894b215f858bc7f4645a56f87e875a749c702ef3aed43e1f2d40f97 WatchSource:0}: Error finding container cad2743b6894b215f858bc7f4645a56f87e875a749c702ef3aed43e1f2d40f97: Status 404 returned error can't find the container with id cad2743b6894b215f858bc7f4645a56f87e875a749c702ef3aed43e1f2d40f97
Jul 06 16:28:42.578221 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.578183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:42.578410 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.578268    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:42.578410 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.578321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:42.578410 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578372    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:28:42.578410 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578397    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:28:42.578596 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578421    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:28:42.578596 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578421    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:28:42.578596 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578461    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:43.578440245 +0000 UTC m=+33.445841451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:28:42.578596 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578481    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:43.578472122 +0000 UTC m=+33.445873335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:28:42.578596 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:42.578494    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:43.5784882 +0000 UTC m=+33.445889405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:28:42.791956 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:42.791920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5s6lf" event={"ID":"cc9aa07f-dbe6-4e3e-856b-10567463e5ad","Type":"ContainerStarted","Data":"cad2743b6894b215f858bc7f4645a56f87e875a749c702ef3aed43e1f2d40f97"}
Jul 06 16:28:43.196236 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.196110    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:43.328561 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.328441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:43.400224 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.400164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:43.499576 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.499545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:43.586449 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.586362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:43.586655 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.586458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:43.586655 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.586514    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:43.586655 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586524    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:28:43.586655 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586546    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:28:43.586655 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586620    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:45.586587771 +0000 UTC m=+35.453988978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:28:43.586655 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586636    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:28:43.586922 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586686    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:45.586672741 +0000 UTC m=+35.454073951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:28:43.586922 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586636    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:28:43.586922 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:43.586729    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:45.586719907 +0000 UTC m=+35.454121114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:28:43.602362 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.602324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:43.640174 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.640134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:43.640373 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.640134    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:43.640373 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.640136    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:43.643171 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.643144    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 16:28:43.643309 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.643232    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 16:28:43.643309 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.643271    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 16:28:43.643423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.643359    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 16:28:43.643423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.643406    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jqc2r\""
Jul 06 16:28:43.643516 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.643481    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jhwls\""
Jul 06 16:28:43.797100 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.797066    2582 generic.go:356] "Generic (PLEG): container finished" podID="764949f2-d89e-4ca3-83ec-78ac11ee46d9" containerID="1ab8fb02d31b4463a27e1ec576f817836f81136a3c24fee0a7f0f9d36fd095e6" exitCode=0
Jul 06 16:28:43.797550 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:43.797122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerDied","Data":"1ab8fb02d31b4463a27e1ec576f817836f81136a3c24fee0a7f0f9d36fd095e6"}
Jul 06 16:28:44.004329 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.004289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:44.062001 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.061956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:44.384628 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.384531    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:44.393906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.393864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:28:44.394066 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.393986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:44.394066 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:44.394034    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 16:28:44.394192 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:44.394096    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:29:16.39408125 +0000 UTC m=+66.261482456 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : secret "metrics-daemon-secret" not found
Jul 06 16:28:44.396539 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.396514    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40211381-eaa5-4224-907c-0d3d4acb9f35-original-pull-secret\") pod \"global-pull-secret-syncer-vltrc\" (UID: \"40211381-eaa5-4224-907c-0d3d4acb9f35\") " pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:44.495201 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.495139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:44.498201 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.498169    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjblw\" (UniqueName: \"kubernetes.io/projected/07626b4f-4641-4d31-b507-7986a9e62683-kube-api-access-pjblw\") pod \"network-check-target-xlzm7\" (UID: \"07626b4f-4641-4d31-b507-7986a9e62683\") " pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:44.559655 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.559620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vltrc"
Jul 06 16:28:44.565889 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.565862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:44.579800 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.579754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:44.722926 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.722729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vltrc"]
Jul 06 16:28:44.741799 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:44.741770    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xlzm7"]
Jul 06 16:28:45.441075 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:45.441040    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40211381_eaa5_4224_907c_0d3d4acb9f35.slice/crio-0e2a517e66562fc40607d66251c2282ef5698460296cac0149c310dd75423712 WatchSource:0}: Error finding container 0e2a517e66562fc40607d66251c2282ef5698460296cac0149c310dd75423712: Status 404 returned error can't find the container with id 0e2a517e66562fc40607d66251c2282ef5698460296cac0149c310dd75423712
Jul 06 16:28:45.441524 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:28:45.441337    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07626b4f_4641_4d31_b507_7986a9e62683.slice/crio-ffac7ec6d641aed0d0626d61211d2bc5a27c03d7dff9842771dfc5005bc694e5 WatchSource:0}: Error finding container ffac7ec6d641aed0d0626d61211d2bc5a27c03d7dff9842771dfc5005bc694e5: Status 404 returned error can't find the container with id ffac7ec6d641aed0d0626d61211d2bc5a27c03d7dff9842771dfc5005bc694e5
Jul 06 16:28:45.605882 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:45.605846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:45.606050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:45.605896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:45.606050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:45.605932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:45.606050 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.605995    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:28:45.606184 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.606058    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:49.60604302 +0000 UTC m=+39.473444226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:28:45.606184 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.606061    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:28:45.606184 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.606075    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:28:45.606184 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.606058    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:28:45.606184 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.606133    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:49.606103794 +0000 UTC m=+39.473504999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:28:45.606184 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:45.606165    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:49.606143322 +0000 UTC m=+39.473544532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:28:45.803224 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:45.803186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xlzm7" event={"ID":"07626b4f-4641-4d31-b507-7986a9e62683","Type":"ContainerStarted","Data":"ffac7ec6d641aed0d0626d61211d2bc5a27c03d7dff9842771dfc5005bc694e5"}
Jul 06 16:28:45.804282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:45.804256    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vltrc" event={"ID":"40211381-eaa5-4224-907c-0d3d4acb9f35","Type":"ContainerStarted","Data":"0e2a517e66562fc40607d66251c2282ef5698460296cac0149c310dd75423712"}
Jul 06 16:28:46.809941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:46.809871    2582 generic.go:356] "Generic (PLEG): container finished" podID="764949f2-d89e-4ca3-83ec-78ac11ee46d9" containerID="d87932633812ab28ae98ff7592fe7c506fa11c00c299903c688c4e13fe887c33" exitCode=0
Jul 06 16:28:46.810417 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:46.809938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerDied","Data":"d87932633812ab28ae98ff7592fe7c506fa11c00c299903c688c4e13fe887c33"}
Jul 06 16:28:46.811858 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:46.811739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5s6lf" event={"ID":"cc9aa07f-dbe6-4e3e-856b-10567463e5ad","Type":"ContainerStarted","Data":"7a4492c803388d874731685f7604896f1635ce6d5711a6b7691a1aa7cb83041c"}
Jul 06 16:28:46.849343 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:46.849275    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5s6lf" podStartSLOduration=2.299413615 podStartE2EDuration="5.849251637s" totalImagesPullingTime="3.549838022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:46.848422904 +0000 UTC m=+36.715824134" watchObservedRunningTime="2026-07-06 16:28:46.849251637 +0000 UTC m=+36.716652869"
Jul 06 16:28:49.259549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:49.259507    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:49.361813 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:49.361776    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:49.637329 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:49.637246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:49.637329 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:49.637296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:49.637329 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:49.637321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637402    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637424    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637435    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637439    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637477    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:57.637459336 +0000 UTC m=+47.504860543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637493    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:57.63748676 +0000 UTC m=+47.504887966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:28:49.637543 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:49.637503    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:57.637498078 +0000 UTC m=+47.504899283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:28:53.832506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.832468    2582 generic.go:356] "Generic (PLEG): container finished" podID="764949f2-d89e-4ca3-83ec-78ac11ee46d9" containerID="a9edebe3cc33940dc883279ef4081cd641118484e01d1cff575337e262542005" exitCode=0
Jul 06 16:28:53.833030 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.832549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerDied","Data":"a9edebe3cc33940dc883279ef4081cd641118484e01d1cff575337e262542005"}
Jul 06 16:28:53.834145 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.834114    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xlzm7" event={"ID":"07626b4f-4641-4d31-b507-7986a9e62683","Type":"ContainerStarted","Data":"f54f7de97b46052166593519fa3a853c3b15332927a4cbf29e1502e259e5ee3f"}
Jul 06 16:28:53.834261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.834214    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:28:53.835584 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.835550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vltrc" event={"ID":"40211381-eaa5-4224-907c-0d3d4acb9f35","Type":"ContainerStarted","Data":"9e81f6ad2f941cb87f301a97d65c3b81db80f79b295a7f3dc496a1f093b6fdf5"}
Jul 06 16:28:53.887621 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.887549    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xlzm7" podStartSLOduration=34.928688235 podStartE2EDuration="42.887527235s" totalImagesPullingTime="7.958839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:53.87497708 +0000 UTC m=+43.742378309" watchObservedRunningTime="2026-07-06 16:28:53.887527235 +0000 UTC m=+43.754928464"
Jul 06 16:28:53.888266 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:53.888222    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vltrc" podStartSLOduration=34.928297961 podStartE2EDuration="42.888207428s" totalImagesPullingTime="7.959909467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:53.887024682 +0000 UTC m=+43.754425910" watchObservedRunningTime="2026-07-06 16:28:53.888207428 +0000 UTC m=+43.755608657"
Jul 06 16:28:54.840408 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:54.840375    2582 generic.go:356] "Generic (PLEG): container finished" podID="764949f2-d89e-4ca3-83ec-78ac11ee46d9" containerID="10ef54ff17957f2b588edbe641b6fa3e5a3a738e512d3bbd510a21653e700fbb" exitCode=0
Jul 06 16:28:54.840875 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:54.840444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerDied","Data":"10ef54ff17957f2b588edbe641b6fa3e5a3a738e512d3bbd510a21653e700fbb"}
Jul 06 16:28:55.846595 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:55.846559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnj85" event={"ID":"764949f2-d89e-4ca3-83ec-78ac11ee46d9","Type":"ContainerStarted","Data":"688f0228bbaa869bcbdcc5445d60a551d7d50627a326794a5d9a084b62979071"}
Jul 06 16:28:55.868133 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:55.868075    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hnj85" podStartSLOduration=12.693616389 podStartE2EDuration="44.868055233s" totalImagesPullingTime="32.174438844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:28:55.867175642 +0000 UTC m=+45.734576870" watchObservedRunningTime="2026-07-06 16:28:55.868055233 +0000 UTC m=+45.735456460"
Jul 06 16:28:55.991743 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:55.991710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:56.091825 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:56.091795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log" limit=1024
Jul 06 16:28:57.697815 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:57.697777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:57.697823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:28:57.697869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.697955    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.697966    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.698003    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.698020    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.698009    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:13.69799618 +0000 UTC m=+63.565397391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.698084    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:13.698068816 +0000 UTC m=+63.565470025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:28:57.698258 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:28:57.698097    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:13.698091261 +0000 UTC m=+63.565492468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:29:08.789434 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:08.789402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wf2pz"
Jul 06 16:29:13.714772 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:13.714724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:13.714785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:13.714817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.714902    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.714918    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.714930    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.714948    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.714987    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:45.714965364 +0000 UTC m=+95.582366589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.715009    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:45.714996372 +0000 UTC m=+95.582397584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:29:13.715151 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:13.715026    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:45.715017867 +0000 UTC m=+95.582419076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:29:16.434374 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:16.434263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:29:16.434808 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:16.434419    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 16:29:16.434808 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:16.434485    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:30:20.43447019 +0000 UTC m=+130.301871397 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : secret "metrics-daemon-secret" not found
Jul 06 16:29:24.843143 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:24.843114    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xlzm7"
Jul 06 16:29:45.753439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:45.753280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:29:45.753439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:45.753325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:29:45.753439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:45.753372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753443    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753462    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753479    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753509    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:30:49.753493521 +0000 UTC m=+159.620894727 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753451    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753544    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:30:49.753525398 +0000 UTC m=+159.620926604 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:29:45.754046 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:29:45.753575    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:30:49.753565227 +0000 UTC m=+159.620966433 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:29:55.756119 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.756086    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"]
Jul 06 16:29:55.758119 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.758104    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:55.760987 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.760964    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 16:29:55.761227 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.761209    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 16:29:55.762009 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.761980    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 16:29:55.762113 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.762092    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 16:29:55.762580 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.762557    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-sh8jt\""
Jul 06 16:29:55.777542 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.777508    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"]
Jul 06 16:29:55.927405 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.927359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/064cd86d-7025-4980-a4fb-7fa038304850-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c\" (UID: \"064cd86d-7025-4980-a4fb-7fa038304850\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:55.927590 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:55.927444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zng2z\" (UniqueName: \"kubernetes.io/projected/064cd86d-7025-4980-a4fb-7fa038304850-kube-api-access-zng2z\") pod \"managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c\" (UID: \"064cd86d-7025-4980-a4fb-7fa038304850\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:56.027998 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.027899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/064cd86d-7025-4980-a4fb-7fa038304850-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c\" (UID: \"064cd86d-7025-4980-a4fb-7fa038304850\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:56.027998 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.027996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zng2z\" (UniqueName: \"kubernetes.io/projected/064cd86d-7025-4980-a4fb-7fa038304850-kube-api-access-zng2z\") pod \"managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c\" (UID: \"064cd86d-7025-4980-a4fb-7fa038304850\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:56.030493 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.030464    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/064cd86d-7025-4980-a4fb-7fa038304850-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c\" (UID: \"064cd86d-7025-4980-a4fb-7fa038304850\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:56.036326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.036303    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zng2z\" (UniqueName: \"kubernetes.io/projected/064cd86d-7025-4980-a4fb-7fa038304850-kube-api-access-zng2z\") pod \"managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c\" (UID: \"064cd86d-7025-4980-a4fb-7fa038304850\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:56.079354 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.079304    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"
Jul 06 16:29:56.204402 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.204364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c"]
Jul 06 16:29:56.208227 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:29:56.208200    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod064cd86d_7025_4980_a4fb_7fa038304850.slice/crio-afc3912a5b207a584a4dddaeed05defef15a106bf1439c9faff08ef4e71e0ca5 WatchSource:0}: Error finding container afc3912a5b207a584a4dddaeed05defef15a106bf1439c9faff08ef4e71e0ca5: Status 404 returned error can't find the container with id afc3912a5b207a584a4dddaeed05defef15a106bf1439c9faff08ef4e71e0ca5
Jul 06 16:29:56.996877 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:56.996812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c" event={"ID":"064cd86d-7025-4980-a4fb-7fa038304850","Type":"ContainerStarted","Data":"afc3912a5b207a584a4dddaeed05defef15a106bf1439c9faff08ef4e71e0ca5"}
Jul 06 16:29:59.003497 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:59.003457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c" event={"ID":"064cd86d-7025-4980-a4fb-7fa038304850","Type":"ContainerStarted","Data":"7d520a2cd1b12e31b1bec07667b1e50aa78a8685ec39caf87f51a90e6becfa5a"}
Jul 06 16:29:59.018129 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:29:59.018074    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c" podStartSLOduration=1.748303964 podStartE2EDuration="4.018054098s" totalImagesPullingTime="2.269750134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:59.017675307 +0000 UTC m=+108.885076537" watchObservedRunningTime="2026-07-06 16:29:59.018054098 +0000 UTC m=+108.885455343"
Jul 06 16:30:20.513439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:20.513386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:30:20.513964 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:20.513542    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 16:30:20.513964 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:20.513633    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:32:22.513598498 +0000 UTC m=+252.380999705 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : secret "metrics-daemon-secret" not found
Jul 06 16:30:44.862445 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:44.862404    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t" podUID="d21d8b9a-b99c-4428-a14d-1347b7cc1bb9"
Jul 06 16:30:44.878645 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:44.878587    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" podUID="16003174-93e8-4401-8713-154defaa17d7"
Jul 06 16:30:44.897966 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:44.897928    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2znm5" podUID="1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50"
Jul 06 16:30:45.118044 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:45.117964    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2znm5"
Jul 06 16:30:45.118194 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:45.117972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:30:45.118194 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:45.117972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:30:46.652657 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:46.652594    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:30:49.829575 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:49.829526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:30:49.829575 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:49.829582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:30:49.829719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829721    2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829784    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829813    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829823    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5fd5f6b8-9qf68: secret "image-registry-tls" not found
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829836    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert podName:d21d8b9a-b99c-4428-a14d-1347b7cc1bb9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:51.829822547 +0000 UTC m=+281.697223753 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-6db2t" (UID: "d21d8b9a-b99c-4428-a14d-1347b7cc1bb9") : secret "networking-console-plugin-cert" not found
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829850    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls podName:1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:51.829843934 +0000 UTC m=+281.697245139 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls") pod "dns-default-2znm5" (UID: "1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50") : secret "dns-default-metrics-tls" not found
Jul 06 16:30:49.830106 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:30:49.829866    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls podName:16003174-93e8-4401-8713-154defaa17d7 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:51.829854434 +0000 UTC m=+281.697255641 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls") pod "image-registry-b5fd5f6b8-9qf68" (UID: "16003174-93e8-4401-8713-154defaa17d7") : secret "image-registry-tls" not found
Jul 06 16:31:01.639479 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:31:01.639438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:31:59.293869 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:31:59.293833    2582 generic.go:356] "Generic (PLEG): container finished" podID="064cd86d-7025-4980-a4fb-7fa038304850" containerID="7d520a2cd1b12e31b1bec07667b1e50aa78a8685ec39caf87f51a90e6becfa5a" exitCode=255
Jul 06 16:31:59.294392 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:31:59.293912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c" event={"ID":"064cd86d-7025-4980-a4fb-7fa038304850","Type":"ContainerDied","Data":"7d520a2cd1b12e31b1bec07667b1e50aa78a8685ec39caf87f51a90e6becfa5a"}
Jul 06 16:31:59.299764 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:31:59.299742    2582 scope.go:117] "RemoveContainer" containerID="7d520a2cd1b12e31b1bec07667b1e50aa78a8685ec39caf87f51a90e6becfa5a"
Jul 06 16:32:00.297834 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:00.297801    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bd8fbb788-lvm7c" event={"ID":"064cd86d-7025-4980-a4fb-7fa038304850","Type":"ContainerStarted","Data":"4e42d6d66129e0d1680ebf04a28538864601d3aa61149cc2c2d1d396e93af372"}
Jul 06 16:32:22.599144 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:22.599090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:32:22.599556 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:22.599249    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 16:32:22.599556 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:22.599319    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs podName:655bddab-22f1-4791-978f-17fa819303af nodeName:}" failed. No retries permitted until 2026-07-06 16:34:24.599299537 +0000 UTC m=+374.466700742 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs") pod "network-metrics-daemon-gw5p5" (UID: "655bddab-22f1-4791-978f-17fa819303af") : secret "metrics-daemon-secret" not found
Jul 06 16:32:25.606213 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.606167    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rkgdw"]
Jul 06 16:32:25.609101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.609085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.611397 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.611372    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 16:32:25.611551 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.611388    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 16:32:25.611551 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.611509    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 16:32:25.612125 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.612104    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 16:32:25.612125 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.612120    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-d4xmf\""
Jul 06 16:32:25.616154 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.616136    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 16:32:25.621720 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.621695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rkgdw"]
Jul 06 16:32:25.708484 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.708446    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-pswbw"]
Jul 06 16:32:25.711182 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.711165    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"]
Jul 06 16:32:25.711302 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.711282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.713938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.713918    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:32:25.714096 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.714077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"
Jul 06 16:32:25.714257 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.714242    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xgdfz\""
Jul 06 16:32:25.714334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.714279    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 16:32:25.715292 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.715272    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 16:32:25.715749 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.715735    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 16:32:25.716099 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.716085    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vqw7n\""
Jul 06 16:32:25.720703 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.720687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8b2ac55e-485e-4031-94a1-be5d25af4507-snapshots\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.720814 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.720711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngrvv\" (UniqueName: \"kubernetes.io/projected/8b2ac55e-485e-4031-94a1-be5d25af4507-kube-api-access-ngrvv\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.720814 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.720731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2ac55e-485e-4031-94a1-be5d25af4507-tmp\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.720814 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.720768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2ac55e-485e-4031-94a1-be5d25af4507-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.720936 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.720853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2ac55e-485e-4031-94a1-be5d25af4507-serving-cert\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.720936 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.720873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2ac55e-485e-4031-94a1-be5d25af4507-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.728730 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.728711    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 16:32:25.732384 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.732359    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-pswbw"]
Jul 06 16:32:25.733081 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.733061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"]
Jul 06 16:32:25.796659 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.796627    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"]
Jul 06 16:32:25.799650 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.799629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:25.803642 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.803624    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hjwsn\""
Jul 06 16:32:25.803978 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.803963    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 16:32:25.804084 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.804063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 16:32:25.804136 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.804085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:32:25.808390 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.808368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"]
Jul 06 16:32:25.822211 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982547b7-cb65-4cba-bfe0-225a473bb273-trusted-ca\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.822391 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2ac55e-485e-4031-94a1-be5d25af4507-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.822391 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2ac55e-485e-4031-94a1-be5d25af4507-tmp\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.822391 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2ac55e-485e-4031-94a1-be5d25af4507-serving-cert\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.822391 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/982547b7-cb65-4cba-bfe0-225a473bb273-serving-cert\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822404    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22bwf\" (UniqueName: \"kubernetes.io/projected/982547b7-cb65-4cba-bfe0-225a473bb273-kube-api-access-22bwf\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p42qb\" (UniqueName: \"kubernetes.io/projected/95ddcdf9-119e-4bb1-b530-49ad9837b646-kube-api-access-p42qb\") pod \"network-check-source-989f8b8dc-5rxck\" (UID: \"95ddcdf9-119e-4bb1-b530-49ad9837b646\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/982547b7-cb65-4cba-bfe0-225a473bb273-config\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8b2ac55e-485e-4031-94a1-be5d25af4507-snapshots\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822554    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b2ac55e-485e-4031-94a1-be5d25af4507-tmp\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngrvv\" (UniqueName: \"kubernetes.io/projected/8b2ac55e-485e-4031-94a1-be5d25af4507-kube-api-access-ngrvv\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.822640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.822620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2ac55e-485e-4031-94a1-be5d25af4507-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.823040 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.823021    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8b2ac55e-485e-4031-94a1-be5d25af4507-snapshots\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.823097 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.823056    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2ac55e-485e-4031-94a1-be5d25af4507-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.823315 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.823294    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2ac55e-485e-4031-94a1-be5d25af4507-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.824771 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.824731    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8b2ac55e-485e-4031-94a1-be5d25af4507-serving-cert\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.835108 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.835082    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngrvv\" (UniqueName: \"kubernetes.io/projected/8b2ac55e-485e-4031-94a1-be5d25af4507-kube-api-access-ngrvv\") pod \"insights-operator-5c847dcfc4-rkgdw\" (UID: \"8b2ac55e-485e-4031-94a1-be5d25af4507\") " pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.918150 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.918065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw"
Jul 06 16:32:25.923296 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/982547b7-cb65-4cba-bfe0-225a473bb273-serving-cert\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.923379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22bwf\" (UniqueName: \"kubernetes.io/projected/982547b7-cb65-4cba-bfe0-225a473bb273-kube-api-access-22bwf\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.923379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:25.923379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p42qb\" (UniqueName: \"kubernetes.io/projected/95ddcdf9-119e-4bb1-b530-49ad9837b646-kube-api-access-p42qb\") pod \"network-check-source-989f8b8dc-5rxck\" (UID: \"95ddcdf9-119e-4bb1-b530-49ad9837b646\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"
Jul 06 16:32:25.923379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/982547b7-cb65-4cba-bfe0-225a473bb273-config\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.923525 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982547b7-cb65-4cba-bfe0-225a473bb273-trusted-ca\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.923525 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.923488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tptk\" (UniqueName: \"kubernetes.io/projected/62551761-42d2-49ae-bc84-178162cc2dfe-kube-api-access-7tptk\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:25.924220 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.924188    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/982547b7-cb65-4cba-bfe0-225a473bb273-config\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.924423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.924403    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982547b7-cb65-4cba-bfe0-225a473bb273-trusted-ca\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.925832 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.925809    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/982547b7-cb65-4cba-bfe0-225a473bb273-serving-cert\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:25.931569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.931549    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p42qb\" (UniqueName: \"kubernetes.io/projected/95ddcdf9-119e-4bb1-b530-49ad9837b646-kube-api-access-p42qb\") pod \"network-check-source-989f8b8dc-5rxck\" (UID: \"95ddcdf9-119e-4bb1-b530-49ad9837b646\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"
Jul 06 16:32:25.931818 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:25.931796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22bwf\" (UniqueName: \"kubernetes.io/projected/982547b7-cb65-4cba-bfe0-225a473bb273-kube-api-access-22bwf\") pod \"console-operator-68b757fb67-pswbw\" (UID: \"982547b7-cb65-4cba-bfe0-225a473bb273\") " pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:26.021019 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.020985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:26.024266 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.024236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:26.024411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.024319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tptk\" (UniqueName: \"kubernetes.io/projected/62551761-42d2-49ae-bc84-178162cc2dfe-kube-api-access-7tptk\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:26.024411 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:26.024399    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:32:26.024511 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:26.024476    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls podName:62551761-42d2-49ae-bc84-178162cc2dfe nodeName:}" failed. No retries permitted until 2026-07-06 16:32:26.524456067 +0000 UTC m=+256.391857296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nzjtw" (UID: "62551761-42d2-49ae-bc84-178162cc2dfe") : secret "samples-operator-tls" not found
Jul 06 16:32:26.025826 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.025813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"
Jul 06 16:32:26.032337 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.032314    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tptk\" (UniqueName: \"kubernetes.io/projected/62551761-42d2-49ae-bc84-178162cc2dfe-kube-api-access-7tptk\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:26.041103 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.041079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rkgdw"]
Jul 06 16:32:26.045101 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:26.045072    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2ac55e_485e_4031_94a1_be5d25af4507.slice/crio-7db1b25fc7b921724069b95f26557ca9f2dc79c222a3dd07b4abbb87a403c1af WatchSource:0}: Error finding container 7db1b25fc7b921724069b95f26557ca9f2dc79c222a3dd07b4abbb87a403c1af: Status 404 returned error can't find the container with id 7db1b25fc7b921724069b95f26557ca9f2dc79c222a3dd07b4abbb87a403c1af
Jul 06 16:32:26.159356 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.159315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck"]
Jul 06 16:32:26.163898 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:26.163867    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ddcdf9_119e_4bb1_b530_49ad9837b646.slice/crio-1c615bb6aafc42ec3bb2b2f257b479d0aa1937dbc4224844c6f51d740e117d0f WatchSource:0}: Error finding container 1c615bb6aafc42ec3bb2b2f257b479d0aa1937dbc4224844c6f51d740e117d0f: Status 404 returned error can't find the container with id 1c615bb6aafc42ec3bb2b2f257b479d0aa1937dbc4224844c6f51d740e117d0f
Jul 06 16:32:26.175168 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.175143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-pswbw"]
Jul 06 16:32:26.178432 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:26.178401    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982547b7_cb65_4cba_bfe0_225a473bb273.slice/crio-b67e2cd788dc306dd6fe513a35ae7b72e596072bcd428d86dbcf8b6ac7298fcc WatchSource:0}: Error finding container b67e2cd788dc306dd6fe513a35ae7b72e596072bcd428d86dbcf8b6ac7298fcc: Status 404 returned error can't find the container with id b67e2cd788dc306dd6fe513a35ae7b72e596072bcd428d86dbcf8b6ac7298fcc
Jul 06 16:32:26.369576 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.369535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" event={"ID":"982547b7-cb65-4cba-bfe0-225a473bb273","Type":"ContainerStarted","Data":"b67e2cd788dc306dd6fe513a35ae7b72e596072bcd428d86dbcf8b6ac7298fcc"}
Jul 06 16:32:26.370677 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.370651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw" event={"ID":"8b2ac55e-485e-4031-94a1-be5d25af4507","Type":"ContainerStarted","Data":"7db1b25fc7b921724069b95f26557ca9f2dc79c222a3dd07b4abbb87a403c1af"}
Jul 06 16:32:26.372101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.372069    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck" event={"ID":"95ddcdf9-119e-4bb1-b530-49ad9837b646","Type":"ContainerStarted","Data":"e7a10f6a83f24b252a3da0eeb782c700c36f4768e3f6f80078aa1f4f586ab61c"}
Jul 06 16:32:26.372222 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.372108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck" event={"ID":"95ddcdf9-119e-4bb1-b530-49ad9837b646","Type":"ContainerStarted","Data":"1c615bb6aafc42ec3bb2b2f257b479d0aa1937dbc4224844c6f51d740e117d0f"}
Jul 06 16:32:26.386653 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.386590    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-5rxck" podStartSLOduration=1.386573829 podStartE2EDuration="1.386573829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:26.385885417 +0000 UTC m=+256.253286658" watchObservedRunningTime="2026-07-06 16:32:26.386573829 +0000 UTC m=+256.253975057"
Jul 06 16:32:26.528706 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:26.528659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:26.528897 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:26.528809    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:32:26.528897 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:26.528876    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls podName:62551761-42d2-49ae-bc84-178162cc2dfe nodeName:}" failed. No retries permitted until 2026-07-06 16:32:27.528860296 +0000 UTC m=+257.396261502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nzjtw" (UID: "62551761-42d2-49ae-bc84-178162cc2dfe") : secret "samples-operator-tls" not found
Jul 06 16:32:27.537534 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:27.537489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:27.538031 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:27.537675    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:32:27.538031 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:27.537761    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls podName:62551761-42d2-49ae-bc84-178162cc2dfe nodeName:}" failed. No retries permitted until 2026-07-06 16:32:29.537740366 +0000 UTC m=+259.405141572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nzjtw" (UID: "62551761-42d2-49ae-bc84-178162cc2dfe") : secret "samples-operator-tls" not found
Jul 06 16:32:29.386263 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.386231    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/0.log"
Jul 06 16:32:29.386714 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.386280    2582 generic.go:356] "Generic (PLEG): container finished" podID="982547b7-cb65-4cba-bfe0-225a473bb273" containerID="8ec8dacd3c557c160bc6bbfa2520f8dd34cc834b0b405a9c9335c3cbf388b010" exitCode=255
Jul 06 16:32:29.386714 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.386381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" event={"ID":"982547b7-cb65-4cba-bfe0-225a473bb273","Type":"ContainerDied","Data":"8ec8dacd3c557c160bc6bbfa2520f8dd34cc834b0b405a9c9335c3cbf388b010"}
Jul 06 16:32:29.386714 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.386637    2582 scope.go:117] "RemoveContainer" containerID="8ec8dacd3c557c160bc6bbfa2520f8dd34cc834b0b405a9c9335c3cbf388b010"
Jul 06 16:32:29.388168 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.388147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw" event={"ID":"8b2ac55e-485e-4031-94a1-be5d25af4507","Type":"ContainerStarted","Data":"3d69b30ec500216de7ba6ad87db0d1d27ad2b9034626dcfe83242125b458dae8"}
Jul 06 16:32:29.418388 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.418336    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw" podStartSLOduration=1.212152045 podStartE2EDuration="4.418319502s" totalImagesPullingTime="3.206167457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:29.417297478 +0000 UTC m=+259.284698720" watchObservedRunningTime="2026-07-06 16:32:29.418319502 +0000 UTC m=+259.285720731"
Jul 06 16:32:29.555268 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:29.555220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:29.555461 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:29.555366    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:32:29.555461 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:29.555430    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls podName:62551761-42d2-49ae-bc84-178162cc2dfe nodeName:}" failed. No retries permitted until 2026-07-06 16:32:33.555413694 +0000 UTC m=+263.422814916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nzjtw" (UID: "62551761-42d2-49ae-bc84-178162cc2dfe") : secret "samples-operator-tls" not found
Jul 06 16:32:30.393044 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.393016    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:32:30.393507 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.393369    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/0.log"
Jul 06 16:32:30.393507 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.393405    2582 generic.go:356] "Generic (PLEG): container finished" podID="982547b7-cb65-4cba-bfe0-225a473bb273" containerID="e76b2346b1fb0a414ae5e0b6db1ed283f0c02ee187c252304ed595f0c1104da8" exitCode=255
Jul 06 16:32:30.393635 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.393490    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" event={"ID":"982547b7-cb65-4cba-bfe0-225a473bb273","Type":"ContainerDied","Data":"e76b2346b1fb0a414ae5e0b6db1ed283f0c02ee187c252304ed595f0c1104da8"}
Jul 06 16:32:30.393635 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.393582    2582 scope.go:117] "RemoveContainer" containerID="8ec8dacd3c557c160bc6bbfa2520f8dd34cc834b0b405a9c9335c3cbf388b010"
Jul 06 16:32:30.393805 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.393788    2582 scope.go:117] "RemoveContainer" containerID="e76b2346b1fb0a414ae5e0b6db1ed283f0c02ee187c252304ed595f0c1104da8"
Jul 06 16:32:30.393992 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:30.393974    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-pswbw_openshift-console-operator(982547b7-cb65-4cba-bfe0-225a473bb273)\"" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" podUID="982547b7-cb65-4cba-bfe0-225a473bb273"
Jul 06 16:32:30.889556 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.889505    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6gpp"]
Jul 06 16:32:30.893886 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.893861    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:30.895981 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.895958    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 16:32:30.896136 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.896117    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 16:32:30.896660 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.896640    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-285th\""
Jul 06 16:32:30.902576 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.902551    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6gpp"]
Jul 06 16:32:30.968313 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.968281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:30.968493 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.968362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh6zk\" (UniqueName: \"kubernetes.io/projected/37d6d521-e827-460e-83aa-deee904f2e7a-kube-api-access-gh6zk\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:30.968493 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.968409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37d6d521-e827-460e-83aa-deee904f2e7a-crio-socket\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:30.968493 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.968425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:30.968637 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:30.968489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37d6d521-e827-460e-83aa-deee904f2e7a-data-volume\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069358 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh6zk\" (UniqueName: \"kubernetes.io/projected/37d6d521-e827-460e-83aa-deee904f2e7a-kube-api-access-gh6zk\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37d6d521-e827-460e-83aa-deee904f2e7a-crio-socket\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37d6d521-e827-460e-83aa-deee904f2e7a-data-volume\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069569 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.069543    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:32:31.069569 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.069557    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:31.069896 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069556    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/37d6d521-e827-460e-83aa-deee904f2e7a-crio-socket\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.069896 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.069629    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:31.569592997 +0000 UTC m=+261.436994203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : configmap "kube-rbac-proxy" not found
Jul 06 16:32:31.069896 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.069650    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:31.569641284 +0000 UTC m=+261.437042489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:31.069896 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.069829    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/37d6d521-e827-460e-83aa-deee904f2e7a-data-volume\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.077760 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.077729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh6zk\" (UniqueName: \"kubernetes.io/projected/37d6d521-e827-460e-83aa-deee904f2e7a-kube-api-access-gh6zk\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.398268 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.398241    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:32:31.398681 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.398552    2582 scope.go:117] "RemoveContainer" containerID="e76b2346b1fb0a414ae5e0b6db1ed283f0c02ee187c252304ed595f0c1104da8"
Jul 06 16:32:31.398737 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.398722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-pswbw_openshift-console-operator(982547b7-cb65-4cba-bfe0-225a473bb273)\"" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" podUID="982547b7-cb65-4cba-bfe0-225a473bb273"
Jul 06 16:32:31.574525 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.574496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.574748 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:31.574540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:31.574748 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.574662    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:32:31.574748 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.574735    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:32.574715572 +0000 UTC m=+262.442116792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : configmap "kube-rbac-proxy" not found
Jul 06 16:32:31.574919 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.574784    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:31.574919 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:31.574839    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:32.574826144 +0000 UTC m=+262.442227349 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:32.582261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:32.582163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:32.582261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:32.582226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:32.582702 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:32.582298    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:32:32.582702 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:32.582325    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:32.582702 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:32.582368    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:34.58235161 +0000 UTC m=+264.449752815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : configmap "kube-rbac-proxy" not found
Jul 06 16:32:32.582702 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:32.582383    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:34.582376673 +0000 UTC m=+264.449777879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:33.415308 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.415266    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mdsch"]
Jul 06 16:32:33.418121 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.418097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.420326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.420297    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 16:32:33.420505 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.420488    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 16:32:33.420561 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.420522    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 16:32:33.421322 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.421302    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vpgkb\""
Jul 06 16:32:33.421322 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.421321    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 16:32:33.426769 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.426746    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mdsch"]
Jul 06 16:32:33.490769 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.490730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00ab7374-38bf-44e7-9877-6fe422e81592-signing-cabundle\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.490769 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.490771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lscdq\" (UniqueName: \"kubernetes.io/projected/00ab7374-38bf-44e7-9877-6fe422e81592-kube-api-access-lscdq\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.490974 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.490857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00ab7374-38bf-44e7-9877-6fe422e81592-signing-key\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.592050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.592013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00ab7374-38bf-44e7-9877-6fe422e81592-signing-key\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.592440 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.592087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:33.592440 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.592203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00ab7374-38bf-44e7-9877-6fe422e81592-signing-cabundle\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.592440 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.592230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lscdq\" (UniqueName: \"kubernetes.io/projected/00ab7374-38bf-44e7-9877-6fe422e81592-kube-api-access-lscdq\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.592440 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:33.592252    2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 16:32:33.592440 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:33.592334    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls podName:62551761-42d2-49ae-bc84-178162cc2dfe nodeName:}" failed. No retries permitted until 2026-07-06 16:32:41.592313308 +0000 UTC m=+271.459714542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nzjtw" (UID: "62551761-42d2-49ae-bc84-178162cc2dfe") : secret "samples-operator-tls" not found
Jul 06 16:32:33.592866 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.592847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00ab7374-38bf-44e7-9877-6fe422e81592-signing-cabundle\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.594475 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.594451    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00ab7374-38bf-44e7-9877-6fe422e81592-signing-key\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.599883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.599861    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lscdq\" (UniqueName: \"kubernetes.io/projected/00ab7374-38bf-44e7-9877-6fe422e81592-kube-api-access-lscdq\") pod \"service-ca-758f599c5-mdsch\" (UID: \"00ab7374-38bf-44e7-9877-6fe422e81592\") " pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.675114 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.675032    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lqx25_2906d07c-60b9-4de3-8cce-3173f346c94f/dns-node-resolver/0.log"
Jul 06 16:32:33.728436 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.728390    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-mdsch"
Jul 06 16:32:33.854139 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:33.854105    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-mdsch"]
Jul 06 16:32:33.857503 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:33.857474    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ab7374_38bf_44e7_9877_6fe422e81592.slice/crio-3c78aba23fffbe83aac22e7525054500f1fb4b1796d3a692af2f7bb198490560 WatchSource:0}: Error finding container 3c78aba23fffbe83aac22e7525054500f1fb4b1796d3a692af2f7bb198490560: Status 404 returned error can't find the container with id 3c78aba23fffbe83aac22e7525054500f1fb4b1796d3a692af2f7bb198490560
Jul 06 16:32:34.408012 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:34.407976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-mdsch" event={"ID":"00ab7374-38bf-44e7-9877-6fe422e81592","Type":"ContainerStarted","Data":"3c78aba23fffbe83aac22e7525054500f1fb4b1796d3a692af2f7bb198490560"}
Jul 06 16:32:34.476391 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:34.476364    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4nzpq_bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7/node-ca/0.log"
Jul 06 16:32:34.601674 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:34.601639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:34.602050 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:34.601692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:34.602050 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:34.601778    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:32:34.602050 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:34.601858    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:38.601840968 +0000 UTC m=+268.469242174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : configmap "kube-rbac-proxy" not found
Jul 06 16:32:34.602050 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:34.601873    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:34.602050 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:34.601920    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:38.601903676 +0000 UTC m=+268.469304884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:35.277543 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:35.277480    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5s6lf_cc9aa07f-dbe6-4e3e-856b-10567463e5ad/serve-healthcheck-canary/0.log"
Jul 06 16:32:36.021262 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:36.021228    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:36.021680 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:36.021314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:36.021727 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:36.021706    2582 scope.go:117] "RemoveContainer" containerID="e76b2346b1fb0a414ae5e0b6db1ed283f0c02ee187c252304ed595f0c1104da8"
Jul 06 16:32:36.021876 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:36.021855    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-pswbw_openshift-console-operator(982547b7-cb65-4cba-bfe0-225a473bb273)\"" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" podUID="982547b7-cb65-4cba-bfe0-225a473bb273"
Jul 06 16:32:37.421767 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:37.421728    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-mdsch" event={"ID":"00ab7374-38bf-44e7-9877-6fe422e81592","Type":"ContainerStarted","Data":"cafc3b75d19e03495c292585c4edea85a4896ca4e0be15b4c2c2acc14b26978e"}
Jul 06 16:32:37.437491 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:37.437433    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-mdsch" podStartSLOduration=1.600468276 podStartE2EDuration="4.43741332s" totalImagesPullingTime="2.836945044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:37.436517496 +0000 UTC m=+267.303918724" watchObservedRunningTime="2026-07-06 16:32:37.43741332 +0000 UTC m=+267.304814546"
Jul 06 16:32:38.633996 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:38.633943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:38.634491 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:38.634106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:38.634491 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:38.634149    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:38.634491 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:38.634200    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 16:32:38.634491 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:38.634257    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:46.634233909 +0000 UTC m=+276.501635119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:38.634491 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:38.634300    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:32:46.634288462 +0000 UTC m=+276.501689671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : configmap "kube-rbac-proxy" not found
Jul 06 16:32:41.657474 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:41.657426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:41.660043 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:41.660013    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/62551761-42d2-49ae-bc84-178162cc2dfe-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nzjtw\" (UID: \"62551761-42d2-49ae-bc84-178162cc2dfe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:41.708628 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:41.708576    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"
Jul 06 16:32:41.838397 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:41.838365    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw"]
Jul 06 16:32:42.442656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:42.442616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw" event={"ID":"62551761-42d2-49ae-bc84-178162cc2dfe","Type":"ContainerStarted","Data":"1f9a4b60f15777b5f9d27a1797200988b7e0fd78d0795209dfb6f6de88bfad60"}
Jul 06 16:32:46.457757 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:46.457721    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw" event={"ID":"62551761-42d2-49ae-bc84-178162cc2dfe","Type":"ContainerStarted","Data":"2776a7c89757dd30364c7d57683dbc3817840a22c072a165a73946621692a2fb"}
Jul 06 16:32:46.458192 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:46.457776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw" event={"ID":"62551761-42d2-49ae-bc84-178162cc2dfe","Type":"ContainerStarted","Data":"be2b32846a29b7cfbc4dd21c7c1aa5819be081fad8791cc50a6b80b10a7cfbea"}
Jul 06 16:32:46.476167 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:46.476114    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nzjtw" podStartSLOduration=17.948805614 podStartE2EDuration="21.476096991s" totalImagesPullingTime="3.527291377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:46.475259884 +0000 UTC m=+276.342661109" watchObservedRunningTime="2026-07-06 16:32:46.476096991 +0000 UTC m=+276.343498218"
Jul 06 16:32:46.701916 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:46.701871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:46.702115 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:46.702013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:46.702115 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:46.702030    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:46.702115 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:46.702097    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls podName:37d6d521-e827-460e-83aa-deee904f2e7a nodeName:}" failed. No retries permitted until 2026-07-06 16:33:02.70207998 +0000 UTC m=+292.569481189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h6gpp" (UID: "37d6d521-e827-460e-83aa-deee904f2e7a") : secret "insights-runtime-extractor-tls" not found
Jul 06 16:32:46.702562 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:46.702540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/37d6d521-e827-460e-83aa-deee904f2e7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:32:48.119402 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:48.119340    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" podUID="16003174-93e8-4401-8713-154defaa17d7"
Jul 06 16:32:48.119402 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:48.119336    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2znm5" podUID="1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50"
Jul 06 16:32:48.119402 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:32:48.119335    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t" podUID="d21d8b9a-b99c-4428-a14d-1347b7cc1bb9"
Jul 06 16:32:48.464669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:48.464568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2znm5"
Jul 06 16:32:48.464669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:48.464568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:32:48.464669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:48.464568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:32:50.642583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:50.642547    2582 scope.go:117] "RemoveContainer" containerID="e76b2346b1fb0a414ae5e0b6db1ed283f0c02ee187c252304ed595f0c1104da8"
Jul 06 16:32:51.475031 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.475004    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:32:51.475201 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.475088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" event={"ID":"982547b7-cb65-4cba-bfe0-225a473bb273","Type":"ContainerStarted","Data":"f4eaa968a7226c6c94a3f0eae6715ea2c110904d09b11eff30d948e971774f5d"}
Jul 06 16:32:51.475374 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.475354    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:51.480232 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.480206    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-pswbw"
Jul 06 16:32:51.494951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.494895    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-pswbw" podStartSLOduration=24.154574465 podStartE2EDuration="26.494878047s" totalImagesPullingTime="2.340303582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:51.493334775 +0000 UTC m=+281.360736002" watchObservedRunningTime="2026-07-06 16:32:51.494878047 +0000 UTC m=+281.362279275"
Jul 06 16:32:51.844476 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.844428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:32:51.844975 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.844488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:32:51.844975 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.844541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:32:51.847019 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.846991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d21d8b9a-b99c-4428-a14d-1347b7cc1bb9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6db2t\" (UID: \"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:32:51.847019 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.847010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50-metrics-tls\") pod \"dns-default-2znm5\" (UID: \"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50\") " pod="openshift-dns/dns-default-2znm5"
Jul 06 16:32:51.847164 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:51.847031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"image-registry-b5fd5f6b8-9qf68\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") " pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:32:52.068707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.068667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hfmwb\""
Jul 06 16:32:52.068707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.068669    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rxcp\""
Jul 06 16:32:52.068959 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.068713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmcqv\""
Jul 06 16:32:52.076507 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.076486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2znm5"
Jul 06 16:32:52.076631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.076566    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"
Jul 06 16:32:52.076697 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.076643    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:32:52.235375 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.235348    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2znm5"]
Jul 06 16:32:52.238864 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:52.238836    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aab3e82_b50f_4c10_b7ad_6a7d2cd50d50.slice/crio-a912a4f9db28288fde5e7d346cc6df4c1e1edff19fdaf5b6fc5261d5b76c5f85 WatchSource:0}: Error finding container a912a4f9db28288fde5e7d346cc6df4c1e1edff19fdaf5b6fc5261d5b76c5f85: Status 404 returned error can't find the container with id a912a4f9db28288fde5e7d346cc6df4c1e1edff19fdaf5b6fc5261d5b76c5f85
Jul 06 16:32:52.458419 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.458320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6db2t"]
Jul 06 16:32:52.462123 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:52.462095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21d8b9a_b99c_4428_a14d_1347b7cc1bb9.slice/crio-39f993bad86494a8d5bb2ca13b822e9ad955568eb36577c0beec12b7f660a5e3 WatchSource:0}: Error finding container 39f993bad86494a8d5bb2ca13b822e9ad955568eb36577c0beec12b7f660a5e3: Status 404 returned error can't find the container with id 39f993bad86494a8d5bb2ca13b822e9ad955568eb36577c0beec12b7f660a5e3
Jul 06 16:32:52.466288 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.466208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5fd5f6b8-9qf68"]
Jul 06 16:32:52.469746 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:32:52.469720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16003174_93e8_4401_8713_154defaa17d7.slice/crio-77f9a3eec8a615d4610338829ac1ccda279c2da262648eccb36f650e66362af5 WatchSource:0}: Error finding container 77f9a3eec8a615d4610338829ac1ccda279c2da262648eccb36f650e66362af5: Status 404 returned error can't find the container with id 77f9a3eec8a615d4610338829ac1ccda279c2da262648eccb36f650e66362af5
Jul 06 16:32:52.480334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.480300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" event={"ID":"16003174-93e8-4401-8713-154defaa17d7","Type":"ContainerStarted","Data":"77f9a3eec8a615d4610338829ac1ccda279c2da262648eccb36f650e66362af5"}
Jul 06 16:32:52.481596 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.481566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2znm5" event={"ID":"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50","Type":"ContainerStarted","Data":"a912a4f9db28288fde5e7d346cc6df4c1e1edff19fdaf5b6fc5261d5b76c5f85"}
Jul 06 16:32:52.482663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:52.482635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t" event={"ID":"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9","Type":"ContainerStarted","Data":"39f993bad86494a8d5bb2ca13b822e9ad955568eb36577c0beec12b7f660a5e3"}
Jul 06 16:32:53.488598 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:53.488543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" event={"ID":"16003174-93e8-4401-8713-154defaa17d7","Type":"ContainerStarted","Data":"726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8"}
Jul 06 16:32:53.518669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:53.518585    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" podStartSLOduration=282.518568517 podStartE2EDuration="4m42.518568517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:53.518187104 +0000 UTC m=+283.385588334" watchObservedRunningTime="2026-07-06 16:32:53.518568517 +0000 UTC m=+283.385969745"
Jul 06 16:32:54.494579 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:54.494526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t" event={"ID":"d21d8b9a-b99c-4428-a14d-1347b7cc1bb9","Type":"ContainerStarted","Data":"9b0b5656de15168793b23ab1ee8bc401e90c5f02e6fa54656dc4d0dfadcf4833"}
Jul 06 16:32:54.495057 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:54.494795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:32:54.509326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:54.509253    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6db2t" podStartSLOduration=271.311312521 podStartE2EDuration="4m32.509232479s" totalImagesPullingTime="1.197919958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:54.508767149 +0000 UTC m=+284.376168389" watchObservedRunningTime="2026-07-06 16:32:54.509232479 +0000 UTC m=+284.376633708"
Jul 06 16:32:56.505339 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:56.505298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2znm5" event={"ID":"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50","Type":"ContainerStarted","Data":"0970783d1a77f7fa7e6e5aab68b5f1c7a1e3e0a0347c86fad615386d6abff9f6"}
Jul 06 16:32:56.505762 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:56.505363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2znm5" event={"ID":"1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50","Type":"ContainerStarted","Data":"5c57538d311bfdc4d1e6a258463119cc0ccfb86db4c511d3448b3cc52c8254a5"}
Jul 06 16:32:56.505762 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:56.505494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2znm5"
Jul 06 16:32:56.521523 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:32:56.521468    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2znm5" podStartSLOduration=252.04302752 podStartE2EDuration="4m15.521449068s" totalImagesPullingTime="3.478421548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:56.520539173 +0000 UTC m=+286.387940399" watchObservedRunningTime="2026-07-06 16:32:56.521449068 +0000 UTC m=+286.388850296"
Jul 06 16:33:02.732986 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:02.732934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:33:02.735306 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:02.735282    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/37d6d521-e827-460e-83aa-deee904f2e7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6gpp\" (UID: \"37d6d521-e827-460e-83aa-deee904f2e7a\") " pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:33:03.003409 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.003367    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6gpp"
Jul 06 16:33:03.138877 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.138840    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6gpp"]
Jul 06 16:33:03.142023 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:33:03.141994    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d6d521_e827_460e_83aa_deee904f2e7a.slice/crio-d28b7d12a1e335955617408cbf1472365a41189b370171e3005f6ebd00fe4c8e WatchSource:0}: Error finding container d28b7d12a1e335955617408cbf1472365a41189b370171e3005f6ebd00fe4c8e: Status 404 returned error can't find the container with id d28b7d12a1e335955617408cbf1472365a41189b370171e3005f6ebd00fe4c8e
Jul 06 16:33:03.530021 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.529984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6gpp" event={"ID":"37d6d521-e827-460e-83aa-deee904f2e7a","Type":"ContainerStarted","Data":"d28b7d12a1e335955617408cbf1472365a41189b370171e3005f6ebd00fe4c8e"}
Jul 06 16:33:03.556222 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.556180    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"]
Jul 06 16:33:03.559671 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.559648    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.561887 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.561860    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 16:33:03.562028 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.561921    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 16:33:03.562028 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.561987    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 16:33:03.562568 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.562540    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 16:33:03.562745 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.562551    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zxtgk\""
Jul 06 16:33:03.562745 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.562696    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 16:33:03.567087 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.567055    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"]
Jul 06 16:33:03.639828 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.639782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f420ce37-4782-4f5b-9d74-992b140c8970-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.640058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.639835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4cnz\" (UniqueName: \"kubernetes.io/projected/f420ce37-4782-4f5b-9d74-992b140c8970-kube-api-access-d4cnz\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.640058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.639937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.640058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.639996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.740773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.740731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f420ce37-4782-4f5b-9d74-992b140c8970-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.740773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.740770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4cnz\" (UniqueName: \"kubernetes.io/projected/f420ce37-4782-4f5b-9d74-992b140c8970-kube-api-access-d4cnz\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.741299 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.740799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.741299 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.740824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.741299 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:03.740914    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 16:33:03.741299 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:03.740969    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-tls podName:f420ce37-4782-4f5b-9d74-992b140c8970 nodeName:}" failed. No retries permitted until 2026-07-06 16:33:04.240954935 +0000 UTC m=+294.108356141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-7tp9c" (UID: "f420ce37-4782-4f5b-9d74-992b140c8970") : secret "prometheus-operator-tls" not found
Jul 06 16:33:03.741437 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.741415    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f420ce37-4782-4f5b-9d74-992b140c8970-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.743444 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.743420    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:03.748664 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:03.748633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4cnz\" (UniqueName: \"kubernetes.io/projected/f420ce37-4782-4f5b-9d74-992b140c8970-kube-api-access-d4cnz\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:04.244640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:04.244391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:04.248413 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:04.248348    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f420ce37-4782-4f5b-9d74-992b140c8970-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tp9c\" (UID: \"f420ce37-4782-4f5b-9d74-992b140c8970\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:04.471423 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:04.471129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"
Jul 06 16:33:04.640757 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:04.640674    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gw5p5" podUID="655bddab-22f1-4791-978f-17fa819303af"
Jul 06 16:33:04.654657 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:04.654627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c"]
Jul 06 16:33:04.657958 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:33:04.657924    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf420ce37_4782_4f5b_9d74_992b140c8970.slice/crio-8608b3a3b45cdb3c3567cd394725656ca7b7a0e4211ac318a5ff2a36d6425cf9 WatchSource:0}: Error finding container 8608b3a3b45cdb3c3567cd394725656ca7b7a0e4211ac318a5ff2a36d6425cf9: Status 404 returned error can't find the container with id 8608b3a3b45cdb3c3567cd394725656ca7b7a0e4211ac318a5ff2a36d6425cf9
Jul 06 16:33:05.541544 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:05.541500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c" event={"ID":"f420ce37-4782-4f5b-9d74-992b140c8970","Type":"ContainerStarted","Data":"8608b3a3b45cdb3c3567cd394725656ca7b7a0e4211ac318a5ff2a36d6425cf9"}
Jul 06 16:33:06.511038 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:06.510999    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2znm5"
Jul 06 16:33:08.553238 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:08.553203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c" event={"ID":"f420ce37-4782-4f5b-9d74-992b140c8970","Type":"ContainerStarted","Data":"5cd0cc992101d4e9762f131ec8174292c76815de66d6af192bd239dc16de673d"}
Jul 06 16:33:08.553665 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:08.553269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c" event={"ID":"f420ce37-4782-4f5b-9d74-992b140c8970","Type":"ContainerStarted","Data":"b46bfa45df340e9cc3ecd8527b282017d54e5795946c1980e1b74f2d10b8cb41"}
Jul 06 16:33:08.554821 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:08.554796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6gpp" event={"ID":"37d6d521-e827-460e-83aa-deee904f2e7a","Type":"ContainerStarted","Data":"b4125ba8b1502b7940dd24d4faed50dd3f86822ce23a972019a509f9877cdf02"}
Jul 06 16:33:08.571594 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:08.571537    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tp9c" podStartSLOduration=2.299942976 podStartE2EDuration="5.571514048s" totalImagesPullingTime="3.271571072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:08.571174044 +0000 UTC m=+298.438575272" watchObservedRunningTime="2026-07-06 16:33:08.571514048 +0000 UTC m=+298.438915309"
Jul 06 16:33:09.559390 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:09.559356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6gpp" event={"ID":"37d6d521-e827-460e-83aa-deee904f2e7a","Type":"ContainerStarted","Data":"f0dc4d0661f878f1e570d1ca518f1be5508cf8235bf8959a7ce70ce31f32f6db"}
Jul 06 16:33:10.523904 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.523856    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:33:10.524444 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.524411    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:33:10.537470 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.537445    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 16:33:10.899973 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.899889    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"]
Jul 06 16:33:10.904754 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.904712    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:10.907259 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.907031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 16:33:10.907259 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.907083    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7rl27\""
Jul 06 16:33:10.907259 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.907142    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 16:33:10.919715 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.919630    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"]
Jul 06 16:33:10.934806 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.934769    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m4dpw"]
Jul 06 16:33:10.938404 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.938379    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:10.941576 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.941520    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 16:33:10.941822 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.941807    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 16:33:10.942057 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.942038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-snrhp\""
Jul 06 16:33:10.942370 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:10.942356    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 16:33:11.008047 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.007998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-wtmp\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008239 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-sys\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008239 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008239 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008239 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gspr\" (UniqueName: \"kubernetes.io/projected/d2d9c283-27a3-4219-910e-b96cb2db46ac-kube-api-access-4gspr\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008239 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22n7t\" (UniqueName: \"kubernetes.io/projected/1d8d9e03-0752-4ffb-8aee-87fd50804904-kube-api-access-22n7t\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.008239 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008232    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-root\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2d9c283-27a3-4219-910e-b96cb2db46ac-metrics-client-ca\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d8d9e03-0752-4ffb-8aee-87fd50804904-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.008549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.008549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-textfile\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.008549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.008425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.109825 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.109787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.109825 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.109835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gspr\" (UniqueName: \"kubernetes.io/projected/d2d9c283-27a3-4219-910e-b96cb2db46ac-kube-api-access-4gspr\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110093 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.109861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22n7t\" (UniqueName: \"kubernetes.io/projected/1d8d9e03-0752-4ffb-8aee-87fd50804904-kube-api-access-22n7t\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.110093 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.109894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-root\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110093 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.109960    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-root\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2d9c283-27a3-4219-910e-b96cb2db46ac-metrics-client-ca\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d8d9e03-0752-4ffb-8aee-87fd50804904-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.110261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.110261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-textfile\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.110550 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-wtmp\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110550 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-sys\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110550 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110550 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:11.110419    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 16:33:11.110550 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:11.110510    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-tls podName:1d8d9e03-0752-4ffb-8aee-87fd50804904 nodeName:}" failed. No retries permitted until 2026-07-06 16:33:11.61049 +0000 UTC m=+301.477891209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-9dqrp" (UID: "1d8d9e03-0752-4ffb-8aee-87fd50804904") : secret "openshift-state-metrics-tls" not found
Jul 06 16:33:11.110842 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110765    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2d9c283-27a3-4219-910e-b96cb2db46ac-metrics-client-ca\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.110842 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:11.110804    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 16:33:11.110952 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:11.110846    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls podName:d2d9c283-27a3-4219-910e-b96cb2db46ac nodeName:}" failed. No retries permitted until 2026-07-06 16:33:11.610831591 +0000 UTC m=+301.478232802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls") pod "node-exporter-m4dpw" (UID: "d2d9c283-27a3-4219-910e-b96cb2db46ac") : secret "node-exporter-tls" not found
Jul 06 16:33:11.111016 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.110977    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-wtmp\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.111066 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.111010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.111066 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.111026    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d2d9c283-27a3-4219-910e-b96cb2db46ac-sys\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.111066 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.111029    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d8d9e03-0752-4ffb-8aee-87fd50804904-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.111357 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.111329    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-textfile\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.113041 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.112991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.113859 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.113834    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.124768 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.124477    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gspr\" (UniqueName: \"kubernetes.io/projected/d2d9c283-27a3-4219-910e-b96cb2db46ac-kube-api-access-4gspr\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.125117 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.125087    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22n7t\" (UniqueName: \"kubernetes.io/projected/1d8d9e03-0752-4ffb-8aee-87fd50804904-kube-api-access-22n7t\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.616483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.616437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:11.616706 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.616501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.616706 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:11.616682    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 16:33:11.616821 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:11.616763    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls podName:d2d9c283-27a3-4219-910e-b96cb2db46ac nodeName:}" failed. No retries permitted until 2026-07-06 16:33:12.616743139 +0000 UTC m=+302.484144347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls") pod "node-exporter-m4dpw" (UID: "d2d9c283-27a3-4219-910e-b96cb2db46ac") : secret "node-exporter-tls" not found
Jul 06 16:33:11.619312 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.619287    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8d9e03-0752-4ffb-8aee-87fd50804904-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-9dqrp\" (UID: \"1d8d9e03-0752-4ffb-8aee-87fd50804904\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:11.819296 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:11.819258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"
Jul 06 16:33:12.083021 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.082975    2582 patch_prober.go:28] interesting pod/image-registry-b5fd5f6b8-9qf68 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 16:33:12.083484 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.083047    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" podUID="16003174-93e8-4401-8713-154defaa17d7" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 16:33:12.234733 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.234696    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp"]
Jul 06 16:33:12.238233 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:33:12.238203    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8d9e03_0752_4ffb_8aee_87fd50804904.slice/crio-770bcf75266dd2acd713a6ab5dd35c298529ec9094582a518b21e4f66d0737d5 WatchSource:0}: Error finding container 770bcf75266dd2acd713a6ab5dd35c298529ec9094582a518b21e4f66d0737d5: Status 404 returned error can't find the container with id 770bcf75266dd2acd713a6ab5dd35c298529ec9094582a518b21e4f66d0737d5
Jul 06 16:33:12.375806 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.375785    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:33:12.572326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.572289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp" event={"ID":"1d8d9e03-0752-4ffb-8aee-87fd50804904","Type":"ContainerStarted","Data":"9bebf3560787a5e29b7169271e0266bb2163e7419d0262bb0991a46aaf388323"}
Jul 06 16:33:12.572505 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.572352    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp" event={"ID":"1d8d9e03-0752-4ffb-8aee-87fd50804904","Type":"ContainerStarted","Data":"eac1ecad50524343e23a18c82422146b2436f0edc8966b4402f47d1dc71fd6a0"}
Jul 06 16:33:12.572505 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.572382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp" event={"ID":"1d8d9e03-0752-4ffb-8aee-87fd50804904","Type":"ContainerStarted","Data":"770bcf75266dd2acd713a6ab5dd35c298529ec9094582a518b21e4f66d0737d5"}
Jul 06 16:33:12.574345 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.574315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6gpp" event={"ID":"37d6d521-e827-460e-83aa-deee904f2e7a","Type":"ContainerStarted","Data":"2d986ba690b45b1ec2e54bbf75e76b84295fbd6603baed14a5f5aae12b2adb32"}
Jul 06 16:33:12.591569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.591501    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6gpp" podStartSLOduration=33.762541833 podStartE2EDuration="42.591477557s" totalImagesPullingTime="8.828935724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:32:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:12.590213016 +0000 UTC m=+302.457614244" watchObservedRunningTime="2026-07-06 16:33:12.591477557 +0000 UTC m=+302.458878785"
Jul 06 16:33:12.627361 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.627264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:12.629787 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.629763    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d2d9c283-27a3-4219-910e-b96cb2db46ac-node-exporter-tls\") pod \"node-exporter-m4dpw\" (UID: \"d2d9c283-27a3-4219-910e-b96cb2db46ac\") " pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:12.752280 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:12.752235    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4dpw"
Jul 06 16:33:12.764562 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:33:12.764521    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d9c283_27a3_4219_910e_b96cb2db46ac.slice/crio-2ccc44d04af427b9496c6ba4cf55da0f274f1f469e078d303f257ad12686c142 WatchSource:0}: Error finding container 2ccc44d04af427b9496c6ba4cf55da0f274f1f469e078d303f257ad12686c142: Status 404 returned error can't find the container with id 2ccc44d04af427b9496c6ba4cf55da0f274f1f469e078d303f257ad12686c142
Jul 06 16:33:13.579627 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:13.579566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dpw" event={"ID":"d2d9c283-27a3-4219-910e-b96cb2db46ac","Type":"ContainerStarted","Data":"2ccc44d04af427b9496c6ba4cf55da0f274f1f469e078d303f257ad12686c142"}
Jul 06 16:33:14.585212 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:14.585175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp" event={"ID":"1d8d9e03-0752-4ffb-8aee-87fd50804904","Type":"ContainerStarted","Data":"d026c268b080c94f561a5838c4e73545c28aa77c57c60331d637cde701b78aa2"}
Jul 06 16:33:14.602649 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:14.602584    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-9dqrp" podStartSLOduration=2.82737856 podStartE2EDuration="4.602567619s" totalImagesPullingTime="1.775189059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:14.600834107 +0000 UTC m=+304.468235335" watchObservedRunningTime="2026-07-06 16:33:14.602567619 +0000 UTC m=+304.469968870"
Jul 06 16:33:14.945220 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:14.945116    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b5fd5f6b8-9qf68"]
Jul 06 16:33:14.949693 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:14.949661    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:33:15.591563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.591528    2582 generic.go:356] "Generic (PLEG): container finished" podID="d2d9c283-27a3-4219-910e-b96cb2db46ac" containerID="6e7493285dbdd6cf6e81ada12a78bc218634f45084e7a681142b6bb5bbbb7427" exitCode=0
Jul 06 16:33:15.592037 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.591633    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dpw" event={"ID":"d2d9c283-27a3-4219-910e-b96cb2db46ac","Type":"ContainerDied","Data":"6e7493285dbdd6cf6e81ada12a78bc218634f45084e7a681142b6bb5bbbb7427"}
Jul 06 16:33:15.737713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.737674    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cc66bb47d-k8bvn"]
Jul 06 16:33:15.741303 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.741271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.743941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.743771    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 16:33:15.743941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.743831    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 16:33:15.743941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.743846    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 16:33:15.743941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.743919    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l5k4m\""
Jul 06 16:33:15.744280 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.744123    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 16:33:15.744344 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.744323    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 16:33:15.744574 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.744554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 16:33:15.744722 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.744637    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 16:33:15.752520 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.752491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 16:33:15.753819 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.753791    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc66bb47d-k8bvn"]
Jul 06 16:33:15.854715 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-service-ca\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.854715 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-oauth-serving-cert\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.854715 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-trusted-ca-bundle\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.854951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-oauth-config\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.854951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-serving-cert\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.854951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-config\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.854951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.854807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfr96\" (UniqueName: \"kubernetes.io/projected/9a575ba3-ba86-4696-86d4-11964ca34b7b-kube-api-access-tfr96\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956086 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-serving-cert\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956086 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-config\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956086 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfr96\" (UniqueName: \"kubernetes.io/projected/9a575ba3-ba86-4696-86d4-11964ca34b7b-kube-api-access-tfr96\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956406 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-service-ca\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956406 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-oauth-serving-cert\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956406 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-trusted-ca-bundle\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956406 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-oauth-config\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956986 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956963    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-oauth-serving-cert\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.956986 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956978    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-service-ca\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.957112 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.956984    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-config\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.957396 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.957377    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-trusted-ca-bundle\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.958636 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.958582    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-serving-cert\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.958737 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.958702    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-oauth-config\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:15.964630 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:15.964589    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfr96\" (UniqueName: \"kubernetes.io/projected/9a575ba3-ba86-4696-86d4-11964ca34b7b-kube-api-access-tfr96\") pod \"console-7cc66bb47d-k8bvn\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") " pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:16.053948 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:16.053908    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:16.190561 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:16.190511    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc66bb47d-k8bvn"]
Jul 06 16:33:16.193140 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:33:16.193115    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a575ba3_ba86_4696_86d4_11964ca34b7b.slice/crio-7cbdba16ab252cb17dd3b067ebd67002568ab69ccf71e68a856d735d6ee885fa WatchSource:0}: Error finding container 7cbdba16ab252cb17dd3b067ebd67002568ab69ccf71e68a856d735d6ee885fa: Status 404 returned error can't find the container with id 7cbdba16ab252cb17dd3b067ebd67002568ab69ccf71e68a856d735d6ee885fa
Jul 06 16:33:16.597335 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:16.597290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc66bb47d-k8bvn" event={"ID":"9a575ba3-ba86-4696-86d4-11964ca34b7b","Type":"ContainerStarted","Data":"7cbdba16ab252cb17dd3b067ebd67002568ab69ccf71e68a856d735d6ee885fa"}
Jul 06 16:33:16.599560 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:16.599529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dpw" event={"ID":"d2d9c283-27a3-4219-910e-b96cb2db46ac","Type":"ContainerStarted","Data":"570b1bc7f4cc54aade69b48ac693acf7dd94db9d318a2f9dbd222b6969cd3f5f"}
Jul 06 16:33:16.599737 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:16.599580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dpw" event={"ID":"d2d9c283-27a3-4219-910e-b96cb2db46ac","Type":"ContainerStarted","Data":"861d34eccbd3e232a5d4441d4e9c0e41b104fede10a9257e43a8d854932944fd"}
Jul 06 16:33:16.629004 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:16.628947    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m4dpw" podStartSLOduration=4.341857495 podStartE2EDuration="6.628931636s" totalImagesPullingTime="2.219373241s" totalInitContainerRuntime="67.7009ms" isStatefulPod=true podCreationTimestamp="2026-07-06 16:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:16.628034366 +0000 UTC m=+306.495435595" watchObservedRunningTime="2026-07-06 16:33:16.628931636 +0000 UTC m=+306.496332865"
Jul 06 16:33:17.171934 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.171893    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:33:17.176404 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.176368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181467    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cc2j3807r6a92\""
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181483    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181499    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181505    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181438    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 16:33:17.181631 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181433    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 16:33:17.182148 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.181752    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 16:33:17.182996 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.182862    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 16:33:17.182996 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.182934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 16:33:17.182996 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.182974    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 16:33:17.183346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.183015    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 16:33:17.183346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.182934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 16:33:17.183346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.183105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 16:33:17.183534 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.182936    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w57n6\""
Jul 06 16:33:17.185734 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.185706    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 16:33:17.192768 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.192404    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 16:33:17.195648 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.195582    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:33:17.268010 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.267975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268250 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7bb9\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-kube-api-access-r7bb9\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.268645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268633    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.269166 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.268666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370078 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370078 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370325 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370325 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370325 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370325 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370271    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370325 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370330    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7bb9\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-kube-api-access-r7bb9\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.370581 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.371035 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.371035 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.371035 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.371035 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.370745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.371242 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.371075    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.372069 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.371718    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.373510 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.373478    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.375310 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.375284    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-web-config\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.376203 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.376180    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.376890 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.376665    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.376998 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.376891    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config-out\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.377883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.377839    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.378785    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.379073    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.379540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.380041    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.380090    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.380137    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.380583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.380428    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.381301 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.381237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.381301 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.381276    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.382066 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.382015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.383101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.383077    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7bb9\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-kube-api-access-r7bb9\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.383101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.383091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.494442 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.494392    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:17.640156 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.640121    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:33:17.680317 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:17.680285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:33:17.684617 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:33:17.684571    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb0bbd0_2441_46d3_8c66_52a69f25d1d0.slice/crio-e07e27a4cc39192f925dc408950b1c812dfc30e815375b58d378d403e3754715 WatchSource:0}: Error finding container e07e27a4cc39192f925dc408950b1c812dfc30e815375b58d378d403e3754715: Status 404 returned error can't find the container with id e07e27a4cc39192f925dc408950b1c812dfc30e815375b58d378d403e3754715
Jul 06 16:33:18.613351 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:18.613306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"e07e27a4cc39192f925dc408950b1c812dfc30e815375b58d378d403e3754715"}
Jul 06 16:33:20.622633 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:20.622576    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0" exitCode=0
Jul 06 16:33:20.623143 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:20.622666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"}
Jul 06 16:33:20.624407 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:20.624375    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc66bb47d-k8bvn" event={"ID":"9a575ba3-ba86-4696-86d4-11964ca34b7b","Type":"ContainerStarted","Data":"413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f"}
Jul 06 16:33:20.670911 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:20.670854    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cc66bb47d-k8bvn" podStartSLOduration=1.859655911 podStartE2EDuration="5.670837006s" totalImagesPullingTime="3.811181095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:20.670648755 +0000 UTC m=+310.538049998" watchObservedRunningTime="2026-07-06 16:33:20.670837006 +0000 UTC m=+310.538238234"
Jul 06 16:33:24.644586 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:24.644493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"}
Jul 06 16:33:24.644586 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:24.644580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"}
Jul 06 16:33:26.054677 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.054625    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:26.055149 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.054700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:26.059750 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.059726    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:26.654379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.654343    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"}
Jul 06 16:33:26.654537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.654427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"}
Jul 06 16:33:26.654537 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.654479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"}
Jul 06 16:33:26.658990 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:26.658965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:33:27.661713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:27.661666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerStarted","Data":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"}
Jul 06 16:33:27.689939 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:27.689872    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6921651840000003 podStartE2EDuration="10.689855567s" totalImagesPullingTime="7.975117817s" totalInitContainerRuntime="22.572566ms" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:27.688663992 +0000 UTC m=+317.556065222" watchObservedRunningTime="2026-07-06 16:33:27.689855567 +0000 UTC m=+317.557256797"
Jul 06 16:33:32.495299 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:32.495262    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:33:39.965621 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:39.965574    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" podUID="16003174-93e8-4401-8713-154defaa17d7" containerName="registry" containerID="cri-o://726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8" gracePeriod=30
Jul 06 16:33:40.221449 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.221386    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:33:40.284536 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284498    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.284759 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-installation-pull-secrets\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.284759 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l759\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-kube-api-access-5l759\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.284759 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-registry-certificates\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.284759 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284669    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16003174-93e8-4401-8713-154defaa17d7-ca-trust-extracted\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.284759 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284722    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-bound-sa-token\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.285027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284762    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-trusted-ca\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.285027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.284799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-image-registry-private-configuration\") pod \"16003174-93e8-4401-8713-154defaa17d7\" (UID: \"16003174-93e8-4401-8713-154defaa17d7\") "
Jul 06 16:33:40.285393 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.285332    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:33:40.285738 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.285711    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:33:40.287125 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.287096    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:33:40.287344 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.287321    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-kube-api-access-5l759" (OuterVolumeSpecName: "kube-api-access-5l759") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "kube-api-access-5l759". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:33:40.287414 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.287326    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:33:40.287523 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.287495    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:33:40.287794 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.287779    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:33:40.296167 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.296130    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16003174-93e8-4401-8713-154defaa17d7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "16003174-93e8-4401-8713-154defaa17d7" (UID: "16003174-93e8-4401-8713-154defaa17d7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:33:40.386373 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386323    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-registry-tls\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386373 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386369    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-installation-pull-secrets\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386373 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386381    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l759\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-kube-api-access-5l759\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386373 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386390    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-registry-certificates\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386674 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386400    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16003174-93e8-4401-8713-154defaa17d7-ca-trust-extracted\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386674 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386409    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16003174-93e8-4401-8713-154defaa17d7-bound-sa-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386674 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386417    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16003174-93e8-4401-8713-154defaa17d7-trusted-ca\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.386674 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.386425    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16003174-93e8-4401-8713-154defaa17d7-image-registry-private-configuration\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:33:40.713149 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.713117    2582 generic.go:356] "Generic (PLEG): container finished" podID="16003174-93e8-4401-8713-154defaa17d7" containerID="726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8" exitCode=0
Jul 06 16:33:40.713334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.713170    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68"
Jul 06 16:33:40.713334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.713182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" event={"ID":"16003174-93e8-4401-8713-154defaa17d7","Type":"ContainerDied","Data":"726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8"}
Jul 06 16:33:40.713334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.713224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5fd5f6b8-9qf68" event={"ID":"16003174-93e8-4401-8713-154defaa17d7","Type":"ContainerDied","Data":"77f9a3eec8a615d4610338829ac1ccda279c2da262648eccb36f650e66362af5"}
Jul 06 16:33:40.713334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.713244    2582 scope.go:117] "RemoveContainer" containerID="726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8"
Jul 06 16:33:40.721726 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.721702    2582 scope.go:117] "RemoveContainer" containerID="726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8"
Jul 06 16:33:40.722044 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:33:40.722021    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8\": container with ID starting with 726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8 not found: ID does not exist" containerID="726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8"
Jul 06 16:33:40.722100 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.722057    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8"} err="failed to get container status \"726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8\": rpc error: code = NotFound desc = could not find container \"726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8\": container with ID starting with 726217afc0782bba9c2f56f894cf85d54179231adc60c1196344b18920f36dc8 not found: ID does not exist"
Jul 06 16:33:40.739462 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.739426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b5fd5f6b8-9qf68"]
Jul 06 16:33:40.743593 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:40.743560    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b5fd5f6b8-9qf68"]
Jul 06 16:33:42.644847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:42.644811    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16003174-93e8-4401-8713-154defaa17d7" path="/var/lib/kubelet/pods/16003174-93e8-4401-8713-154defaa17d7/volumes"
Jul 06 16:33:50.757064 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:50.757031    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b2ac55e-485e-4031-94a1-be5d25af4507" containerID="3d69b30ec500216de7ba6ad87db0d1d27ad2b9034626dcfe83242125b458dae8" exitCode=0
Jul 06 16:33:50.757453 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:50.757103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw" event={"ID":"8b2ac55e-485e-4031-94a1-be5d25af4507","Type":"ContainerDied","Data":"3d69b30ec500216de7ba6ad87db0d1d27ad2b9034626dcfe83242125b458dae8"}
Jul 06 16:33:50.757494 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:50.757456    2582 scope.go:117] "RemoveContainer" containerID="3d69b30ec500216de7ba6ad87db0d1d27ad2b9034626dcfe83242125b458dae8"
Jul 06 16:33:51.762813 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:33:51.762774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rkgdw" event={"ID":"8b2ac55e-485e-4031-94a1-be5d25af4507","Type":"ContainerStarted","Data":"b1e4166045c75a3e60d99bc028911682d8429772e8f97ea1827ef194cc43cf6a"}
Jul 06 16:34:17.494901 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:17.494854    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:17.514871 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:17.514843    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:17.882637 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:17.882544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:24.696196 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:24.696152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:34:24.698615 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:24.698578    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/655bddab-22f1-4791-978f-17fa819303af-metrics-certs\") pod \"network-metrics-daemon-gw5p5\" (UID: \"655bddab-22f1-4791-978f-17fa819303af\") " pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:34:24.843411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:24.843382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jhwls\""
Jul 06 16:34:24.852079 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:24.852056    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gw5p5"
Jul 06 16:34:24.984215 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:24.984192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gw5p5"]
Jul 06 16:34:24.986221 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:34:24.986195    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655bddab_22f1_4791_978f_17fa819303af.slice/crio-252740452f0d39f15c6065afdb7dc9f516fc3a14e9988f560b942dad0b6d1346 WatchSource:0}: Error finding container 252740452f0d39f15c6065afdb7dc9f516fc3a14e9988f560b942dad0b6d1346: Status 404 returned error can't find the container with id 252740452f0d39f15c6065afdb7dc9f516fc3a14e9988f560b942dad0b6d1346
Jul 06 16:34:25.901847 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:25.901808    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gw5p5" event={"ID":"655bddab-22f1-4791-978f-17fa819303af","Type":"ContainerStarted","Data":"252740452f0d39f15c6065afdb7dc9f516fc3a14e9988f560b942dad0b6d1346"}
Jul 06 16:34:26.907731 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:26.907694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gw5p5" event={"ID":"655bddab-22f1-4791-978f-17fa819303af","Type":"ContainerStarted","Data":"08658478b3e697d283af8d2c987271251e77a5c8a6d61d9e0f6871e676742f7d"}
Jul 06 16:34:26.908114 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:26.907754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gw5p5" event={"ID":"655bddab-22f1-4791-978f-17fa819303af","Type":"ContainerStarted","Data":"1c95961d6f24b3cc7ef4292d5f5d54f774477061a0465e5148257c82e87bac6f"}
Jul 06 16:34:26.924841 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:26.924788    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gw5p5" podStartSLOduration=374.84308389 podStartE2EDuration="6m15.924772889s" totalImagesPullingTime="1.081688999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:34:26.923525985 +0000 UTC m=+376.790927226" watchObservedRunningTime="2026-07-06 16:34:26.924772889 +0000 UTC m=+376.792174116"
Jul 06 16:34:35.602136 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602098    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:34:35.602664 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602493    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="prometheus" containerID="cri-o://dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74" gracePeriod=600
Jul 06 16:34:35.602749 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602664    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-web" containerID="cri-o://d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb" gracePeriod=600
Jul 06 16:34:35.602749 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602697    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy" containerID="cri-o://d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1" gracePeriod=600
Jul 06 16:34:35.602865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602755    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a" gracePeriod=600
Jul 06 16:34:35.602865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602753    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="config-reloader" containerID="cri-o://b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6" gracePeriod=600
Jul 06 16:34:35.602865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.602731    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="thanos-sidecar" containerID="cri-o://c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b" gracePeriod=600
Jul 06 16:34:35.866348 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.866282    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:35.950129 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950092    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a" exitCode=0
Jul 06 16:34:35.950129 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950124    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1" exitCode=0
Jul 06 16:34:35.950129 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950134    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb" exitCode=0
Jul 06 16:34:35.950129 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950144    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b" exitCode=0
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950152    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6" exitCode=0
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950161    2582 generic.go:356] "Generic (PLEG): container finished" podID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74" exitCode=0
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"}
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950234    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"}
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"}
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"}
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950349    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"}
Jul 06 16:34:35.950403 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"}
Jul 06 16:34:35.950821 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.950425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efb0bbd0-2441-46d3-8c66-52a69f25d1d0","Type":"ContainerDied","Data":"e07e27a4cc39192f925dc408950b1c812dfc30e815375b58d378d403e3754715"}
Jul 06 16:34:35.959306 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.959288    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:35.966804 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.966777    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:35.974097 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.974076    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:35.981831 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.981808    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:35.989476 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.989453    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:35.992857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992834    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-web-config\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.992965 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992892    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config-out\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.992965 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-db\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.992965 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.992965 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-metrics-client-ca\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-2\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.992996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-thanos-prometheus-http-client-file\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993019    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993056    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-kube-rbac-proxy\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993094    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993142    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-tls\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7bb9\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-kube-api-access-r7bb9\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993190    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-tls-assets\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993228    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-trusted-ca-bundle\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993257    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-serving-certs-ca-bundle\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-1\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993332    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993337    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-metrics-client-certs\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993390    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-kubelet-serving-ca-bundle\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993425    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-grpc-tls\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993452    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-0\") pod \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\" (UID: \"efb0bbd0-2441-46d3-8c66-52a69f25d1d0\") "
Jul 06 16:34:35.993985 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.993744    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-metrics-client-ca\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:35.994254 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.994221    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:34:35.995328 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.994756    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.995328 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.995066    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.995854 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.995426    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.995854 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.995790    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.995989 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.995885    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.995989 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.995950    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.996402 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.996172    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.996402 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.996294    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config" (OuterVolumeSpecName: "config") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.996555 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.996524    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:34:35.996862 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.996648    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config-out" (OuterVolumeSpecName: "config-out") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:34:35.996862 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.996678    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.998351 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.998323    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.998670 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.998587    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.998767 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.998738    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:34:35.999165 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.999146    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.999245 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.999181    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:35.999332 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:35.999313    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-kube-api-access-r7bb9" (OuterVolumeSpecName: "kube-api-access-r7bb9") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "kube-api-access-r7bb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:34:36.000652 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.000636    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.007529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.007504    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-web-config" (OuterVolumeSpecName: "web-config") pod "efb0bbd0-2441-46d3-8c66-52a69f25d1d0" (UID: "efb0bbd0-2441-46d3-8c66-52a69f25d1d0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:34:36.008262 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.008246    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.008559 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.008522    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.008667 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.008565    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"} err="failed to get container status \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist"
Jul 06 16:34:36.008667 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.008583    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.008891 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.008871    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.008930 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.008897    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"} err="failed to get container status \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist"
Jul 06 16:34:36.008930 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.008913    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.009153 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.009137    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.009216 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009161    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"} err="failed to get container status \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist"
Jul 06 16:34:36.009216 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009178    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.009407 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.009393    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.009454 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009408    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"} err="failed to get container status \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist"
Jul 06 16:34:36.009454 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009419    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.009657 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.009640    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.009695 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009662    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"} err="failed to get container status \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist"
Jul 06 16:34:36.009695 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009676    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.009887 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.009872    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.009926 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009892    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"} err="failed to get container status \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist"
Jul 06 16:34:36.009926 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.009904    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.010118 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:34:36.010104    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.010162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010120    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"} err="failed to get container status \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist"
Jul 06 16:34:36.010162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010131    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.010309 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010292    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"} err="failed to get container status \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist"
Jul 06 16:34:36.010348 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010310    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.010491 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010475    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"} err="failed to get container status \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist"
Jul 06 16:34:36.010535 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010491    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.010683 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010668    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"} err="failed to get container status \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist"
Jul 06 16:34:36.010729 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010683    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.010854 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010841    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"} err="failed to get container status \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist"
Jul 06 16:34:36.010899 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.010855    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.011047 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011027    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"} err="failed to get container status \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist"
Jul 06 16:34:36.011104 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011048    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.011279 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011264    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"} err="failed to get container status \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist"
Jul 06 16:34:36.011279 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011278    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.011481 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011466    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"} err="failed to get container status \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist"
Jul 06 16:34:36.011529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011481    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.011765 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011748    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"} err="failed to get container status \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist"
Jul 06 16:34:36.011828 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011767    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.011976 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011958    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"} err="failed to get container status \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist"
Jul 06 16:34:36.012030 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.011977    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.012202 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012179    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"} err="failed to get container status \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist"
Jul 06 16:34:36.012275 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012203    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.012429 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012412    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"} err="failed to get container status \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist"
Jul 06 16:34:36.012470 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012429    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.012646 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012628    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"} err="failed to get container status \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist"
Jul 06 16:34:36.012710 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012648    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.012862 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012845    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"} err="failed to get container status \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist"
Jul 06 16:34:36.012924 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.012864    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.013101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013082    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"} err="failed to get container status \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist"
Jul 06 16:34:36.013148 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013101    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.013252 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013235    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"} err="failed to get container status \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist"
Jul 06 16:34:36.013316 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013253    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.013451 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013433    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"} err="failed to get container status \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist"
Jul 06 16:34:36.013499 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013452    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.013694 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013677    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"} err="failed to get container status \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist"
Jul 06 16:34:36.013767 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013695    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.013939 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013921    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"} err="failed to get container status \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist"
Jul 06 16:34:36.013982 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.013940    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.014149 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014132    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"} err="failed to get container status \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist"
Jul 06 16:34:36.014217 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014151    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.014364 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014346    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"} err="failed to get container status \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist"
Jul 06 16:34:36.014405 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014376    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.014572 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014557    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"} err="failed to get container status \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist"
Jul 06 16:34:36.014572 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014572    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.014776 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014758    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"} err="failed to get container status \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist"
Jul 06 16:34:36.014825 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014776    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.014994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014976    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"} err="failed to get container status \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist"
Jul 06 16:34:36.015064 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.014995    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.015198 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015184    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"} err="failed to get container status \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist"
Jul 06 16:34:36.015244 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015198    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.015381 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015359    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"} err="failed to get container status \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist"
Jul 06 16:34:36.015456 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015382    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.015630 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015589    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"} err="failed to get container status \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist"
Jul 06 16:34:36.015630 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015624    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.015879 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015862    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"} err="failed to get container status \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist"
Jul 06 16:34:36.015952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.015880    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.016157 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016137    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"} err="failed to get container status \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist"
Jul 06 16:34:36.016232 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016157    2582 scope.go:117] "RemoveContainer" containerID="b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"
Jul 06 16:34:36.016415 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016400    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a"} err="failed to get container status \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": rpc error: code = NotFound desc = could not find container \"b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a\": container with ID starting with b2f86726791db4b25c0d3b8d7b13ef84fe23a270c6fa5b2e61607d85121b3d4a not found: ID does not exist"
Jul 06 16:34:36.016455 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016416    2582 scope.go:117] "RemoveContainer" containerID="d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"
Jul 06 16:34:36.016658 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016641    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1"} err="failed to get container status \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": rpc error: code = NotFound desc = could not find container \"d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1\": container with ID starting with d69e33a5261992a612424203e38490fe246bccfc5ad357fd90e86cf604a39ea1 not found: ID does not exist"
Jul 06 16:34:36.016658 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016657    2582 scope.go:117] "RemoveContainer" containerID="d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"
Jul 06 16:34:36.016907 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016892    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb"} err="failed to get container status \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": rpc error: code = NotFound desc = could not find container \"d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb\": container with ID starting with d1f25ff9db4cb187495d6892e1ae299f1298813411b938647687dfb72e94a4bb not found: ID does not exist"
Jul 06 16:34:36.016947 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.016909    2582 scope.go:117] "RemoveContainer" containerID="c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"
Jul 06 16:34:36.017146 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017126    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b"} err="failed to get container status \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": rpc error: code = NotFound desc = could not find container \"c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b\": container with ID starting with c331c3e7dbbcd8dbf8fe27ee56e4767c8723e54c36348102e969fd41edac934b not found: ID does not exist"
Jul 06 16:34:36.017193 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017147    2582 scope.go:117] "RemoveContainer" containerID="b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"
Jul 06 16:34:36.017368 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017349    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6"} err="failed to get container status \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": rpc error: code = NotFound desc = could not find container \"b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6\": container with ID starting with b101beaabe75cb8e4bad8e95b301488dfc6949a7ad56c98baf5db9b93733e6b6 not found: ID does not exist"
Jul 06 16:34:36.017416 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017370    2582 scope.go:117] "RemoveContainer" containerID="dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"
Jul 06 16:34:36.017562 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017544    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74"} err="failed to get container status \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": rpc error: code = NotFound desc = could not find container \"dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74\": container with ID starting with dc64862b5c3e2d081f6065c606894060082365f530aa6649784b59fcb52a6f74 not found: ID does not exist"
Jul 06 16:34:36.017627 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017562    2582 scope.go:117] "RemoveContainer" containerID="1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"
Jul 06 16:34:36.017780 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.017764    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0"} err="failed to get container status \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": rpc error: code = NotFound desc = could not find container \"1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0\": container with ID starting with 1be45d414c75878cf05d0686b28f5e2b4cb0af8b66ebb8a585ab12c0218a98d0 not found: ID does not exist"
Jul 06 16:34:36.094445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094404    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-metrics-client-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094440    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094454    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-grpc-tls\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094476    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094489    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-web-config\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094500    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config-out\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094512    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-db\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094524    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094540    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094553    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094565    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-config\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094577    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-kube-rbac-proxy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094589    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094628    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094641    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7bb9\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-kube-api-access-r7bb9\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094654    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-tls-assets\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094667    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094679    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.094766 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.094695    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efb0bbd0-2441-46d3-8c66-52a69f25d1d0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:34:36.275973 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.275940    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:34:36.286942 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.286910    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:34:36.312330 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312293    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:34:36.312584 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312571    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="init-config-reloader"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312585    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="init-config-reloader"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312598    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="prometheus"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312616    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="prometheus"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312625    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16003174-93e8-4401-8713-154defaa17d7" containerName="registry"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312631    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="16003174-93e8-4401-8713-154defaa17d7" containerName="registry"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312639    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312644    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312650    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-thanos"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312655    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-thanos"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312663    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="config-reloader"
Jul 06 16:34:36.312663 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312668    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="config-reloader"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312674    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="thanos-sidecar"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312680    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="thanos-sidecar"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312687    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-web"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312694    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-web"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312739    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="thanos-sidecar"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312747    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-thanos"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312754    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="16003174-93e8-4401-8713-154defaa17d7" containerName="registry"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312760    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="prometheus"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312768    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="config-reloader"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312773    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy"
Jul 06 16:34:36.313027 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.312779    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" containerName="kube-rbac-proxy-web"
Jul 06 16:34:36.317990 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.317958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.322285 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.321999    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 16:34:36.323420 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.323201    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 16:34:36.323555 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.323533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 16:34:36.323895 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.323873    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 16:34:36.324404 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.324371    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 16:34:36.329319 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.328181    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 16:34:36.329319 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.328453    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 16:34:36.329319 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.328788    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 16:34:36.329660 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.329414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 16:34:36.329660 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.329508    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 16:34:36.329772 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.329737    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 16:34:36.330030 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.329995    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 16:34:36.330145 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.330110    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-w57n6\""
Jul 06 16:34:36.330238 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.330199    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cc2j3807r6a92\""
Jul 06 16:34:36.331038 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.330319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 16:34:36.333056 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.333034    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 16:34:36.333164 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.333041    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 16:34:36.334138 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.334117    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:34:36.397436 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-config\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397436 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397717 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397459    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfjz9\" (UniqueName: \"kubernetes.io/projected/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-kube-api-access-lfjz9\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397717 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397549    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397717 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397717 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397717 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.397906 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.398183 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.398183 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.398183 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.397976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.398183 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.398006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.498557 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.498557 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.498896 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.498896 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.498896 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.498896 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499102 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.498976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-config\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499102 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499102 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfjz9\" (UniqueName: \"kubernetes.io/projected/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-kube-api-access-lfjz9\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499102 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499155    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499166    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499200    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499694 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499694 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499694 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499694 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.499908 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.499884    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.501590 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.501558    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.501952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.501784    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.501952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.501932    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.502128 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.501935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.502298 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.502221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-config\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.502298 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.502221    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503170 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.502701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503170 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.502712    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503170 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.502829    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503170 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.503001    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503170 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.503110    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503474 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.503229    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.503987 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.503965    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.504282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.504261    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.504493 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.504476    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.505407 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.505383    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.506868 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.506851    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfjz9\" (UniqueName: \"kubernetes.io/projected/fe6b7e61-e0a5-41fd-8f32-89481c5f09a5-kube-api-access-lfjz9\") pod \"prometheus-k8s-0\" (UID: \"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.633672 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.633628    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:36.645058 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.645033    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb0bbd0-2441-46d3-8c66-52a69f25d1d0" path="/var/lib/kubelet/pods/efb0bbd0-2441-46d3-8c66-52a69f25d1d0/volumes"
Jul 06 16:34:36.779104 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.779067    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 16:34:36.782171 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:34:36.782141    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6b7e61_e0a5_41fd_8f32_89481c5f09a5.slice/crio-df4ac33b5ad56df2dd6c181459c57765e07022e9bcd26e203a3595cedc28655c WatchSource:0}: Error finding container df4ac33b5ad56df2dd6c181459c57765e07022e9bcd26e203a3595cedc28655c: Status 404 returned error can't find the container with id df4ac33b5ad56df2dd6c181459c57765e07022e9bcd26e203a3595cedc28655c
Jul 06 16:34:36.955937 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.955903    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe6b7e61-e0a5-41fd-8f32-89481c5f09a5" containerID="420de1b8add80f4c17d504563b5578c92ca86a9aa36e51bab81f08d601ee7999" exitCode=0
Jul 06 16:34:36.956128 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.955987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerDied","Data":"420de1b8add80f4c17d504563b5578c92ca86a9aa36e51bab81f08d601ee7999"}
Jul 06 16:34:36.956128 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:36.956070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"df4ac33b5ad56df2dd6c181459c57765e07022e9bcd26e203a3595cedc28655c"}
Jul 06 16:34:37.965549 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.965511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"eb812bd997223a7b4dbc091a8a41b29fdf5d05b70af1f0c7cb602f0de3b254c8"}
Jul 06 16:34:37.965952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.965580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"3b479f9c3dac36ed6f360f0b0ff879085f60c7311f79112509be7000d85f3e97"}
Jul 06 16:34:37.965952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.965628    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"f834f54269c694eb3d85dacfccd6d4e8e6f4747ca18baddb427e47c7eecc9853"}
Jul 06 16:34:37.965952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.965655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"2dfe9924f11921aa2810d0bf4d5f7b0d4c7e833f59fecc4f57aefbc26e013d96"}
Jul 06 16:34:37.965952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.965687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"857dcf5952492c093b36616de47db9133756124c6275a46afaad2d59c9a5bd98"}
Jul 06 16:34:37.965952 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.965713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe6b7e61-e0a5-41fd-8f32-89481c5f09a5","Type":"ContainerStarted","Data":"9a81852bf01cc213ffc9d23b6f1414521461a049ad5f5f6b9bd579ac6d7f5588"}
Jul 06 16:34:37.993938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:37.993888    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.974312087 podStartE2EDuration="1.993870055s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.557968ms" isStatefulPod=false podCreationTimestamp="2026-07-06 16:34:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:34:37.991508982 +0000 UTC m=+387.858910209" watchObservedRunningTime="2026-07-06 16:34:37.993870055 +0000 UTC m=+387.861271292"
Jul 06 16:34:41.634197 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:41.634154    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:34:51.731419 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:34:51.731373    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc66bb47d-k8bvn"]
Jul 06 16:35:16.760916 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:16.760869    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cc66bb47d-k8bvn" podUID="9a575ba3-ba86-4696-86d4-11964ca34b7b" containerName="console" containerID="cri-o://413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f" gracePeriod=15
Jul 06 16:35:17.002718 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.002688    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:35:17.043800 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043704    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-service-ca\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.043800 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043755    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-config\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.043800 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-serving-cert\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.044071 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043829    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfr96\" (UniqueName: \"kubernetes.io/projected/9a575ba3-ba86-4696-86d4-11964ca34b7b-kube-api-access-tfr96\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.044071 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043857    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-oauth-config\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.044071 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043879    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-trusted-ca-bundle\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.044071 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.043907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-oauth-serving-cert\") pod \"9a575ba3-ba86-4696-86d4-11964ca34b7b\" (UID: \"9a575ba3-ba86-4696-86d4-11964ca34b7b\") "
Jul 06 16:35:17.044282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.044152    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:35:17.044282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.044234    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-config" (OuterVolumeSpecName: "console-config") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:35:17.044463 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.044440    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:35:17.044504 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.044446    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:35:17.046181 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.046149    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:35:17.046181 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.046156    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a575ba3-ba86-4696-86d4-11964ca34b7b-kube-api-access-tfr96" (OuterVolumeSpecName: "kube-api-access-tfr96") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "kube-api-access-tfr96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:35:17.046331 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.046195    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a575ba3-ba86-4696-86d4-11964ca34b7b" (UID: "9a575ba3-ba86-4696-86d4-11964ca34b7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 16:35:17.129951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.129897    2582 generic.go:356] "Generic (PLEG): container finished" podID="9a575ba3-ba86-4696-86d4-11964ca34b7b" containerID="413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f" exitCode=0
Jul 06 16:35:17.129951 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.129941    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc66bb47d-k8bvn"
Jul 06 16:35:17.130257 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.129997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc66bb47d-k8bvn" event={"ID":"9a575ba3-ba86-4696-86d4-11964ca34b7b","Type":"ContainerDied","Data":"413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f"}
Jul 06 16:35:17.130257 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.130048    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc66bb47d-k8bvn" event={"ID":"9a575ba3-ba86-4696-86d4-11964ca34b7b","Type":"ContainerDied","Data":"7cbdba16ab252cb17dd3b067ebd67002568ab69ccf71e68a856d735d6ee885fa"}
Jul 06 16:35:17.130257 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.130077    2582 scope.go:117] "RemoveContainer" containerID="413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f"
Jul 06 16:35:17.139074 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.139051    2582 scope.go:117] "RemoveContainer" containerID="413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f"
Jul 06 16:35:17.139379 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:35:17.139358    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f\": container with ID starting with 413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f not found: ID does not exist" containerID="413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f"
Jul 06 16:35:17.139450 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.139392    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f"} err="failed to get container status \"413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f\": rpc error: code = NotFound desc = could not find container \"413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f\": container with ID starting with 413ab358fff92fcff070937a2b6fe37eadbcfe354a1f5ec23ce1d710181b356f not found: ID does not exist"
Jul 06 16:35:17.144785 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144757    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-trusted-ca-bundle\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.144785 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144784    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-oauth-serving-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.144785 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144794    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-service-ca\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.144977 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144802    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-config\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.144977 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144811    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-serving-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.144977 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144820    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfr96\" (UniqueName: \"kubernetes.io/projected/9a575ba3-ba86-4696-86d4-11964ca34b7b-kube-api-access-tfr96\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.144977 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.144828    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a575ba3-ba86-4696-86d4-11964ca34b7b-console-oauth-config\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:35:17.150363 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.150328    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc66bb47d-k8bvn"]
Jul 06 16:35:17.152534 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:17.152508    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cc66bb47d-k8bvn"]
Jul 06 16:35:18.644099 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:18.644066    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a575ba3-ba86-4696-86d4-11964ca34b7b" path="/var/lib/kubelet/pods/9a575ba3-ba86-4696-86d4-11964ca34b7b/volumes"
Jul 06 16:35:36.634410 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:36.634366    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:35:36.651346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:36.651314    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:35:37.222225 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:35:37.222197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 16:37:41.251860 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.251829    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"]
Jul 06 16:37:41.252283 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.252107    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a575ba3-ba86-4696-86d4-11964ca34b7b" containerName="console"
Jul 06 16:37:41.252283 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.252117    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a575ba3-ba86-4696-86d4-11964ca34b7b" containerName="console"
Jul 06 16:37:41.252283 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.252200    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a575ba3-ba86-4696-86d4-11964ca34b7b" containerName="console"
Jul 06 16:37:41.255268 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.255241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.265999 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.265969    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 16:37:41.265999 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.265986    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 16:37:41.266406 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.266384    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 16:37:41.266476 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.266459    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 16:37:41.266835 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.266823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nfd8f\""
Jul 06 16:37:41.305882 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.305846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"]
Jul 06 16:37:41.337121 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.337085    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.337341 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.337140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhnqh\" (UniqueName: \"kubernetes.io/projected/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-kube-api-access-fhnqh\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.337341 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.337166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-tmp\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.337341 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.337235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-manifests\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.337341 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.337272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.438450 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.438407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-manifests\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.438450 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.438450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.438763 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.438504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.438763 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.438544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhnqh\" (UniqueName: \"kubernetes.io/projected/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-kube-api-access-fhnqh\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.438763 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.438566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-tmp\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.438943 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.438918    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-manifests\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.440865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.440834    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-tmp\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.441117 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.441098    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.441247 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.441226    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.449652 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.449592    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhnqh\" (UniqueName: \"kubernetes.io/projected/5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe-kube-api-access-fhnqh\") pod \"opendatahub-operator-controller-manager-bb6889b66-px5gf\" (UID: \"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.565002 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.564907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:41.705249 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:41.705207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"]
Jul 06 16:37:41.708144 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:37:41.708117    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6ac1f2_61fe_4d05_aaea_fb5fdcc94cfe.slice/crio-9f9338abb5653c826b672f2806f8c96fb233e72467632ab5d9535fc19f4318f5 WatchSource:0}: Error finding container 9f9338abb5653c826b672f2806f8c96fb233e72467632ab5d9535fc19f4318f5: Status 404 returned error can't find the container with id 9f9338abb5653c826b672f2806f8c96fb233e72467632ab5d9535fc19f4318f5
Jul 06 16:37:42.685886 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:42.685853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf" event={"ID":"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe","Type":"ContainerStarted","Data":"9f9338abb5653c826b672f2806f8c96fb233e72467632ab5d9535fc19f4318f5"}
Jul 06 16:37:45.701138 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:45.701092    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf" event={"ID":"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe","Type":"ContainerStarted","Data":"01d76150ae7bd344dbfcc885f25c6289879c24907c9ac9d68c081f8edcc8a917"}
Jul 06 16:37:46.706814 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:46.706778    2582 generic.go:356] "Generic (PLEG): container finished" podID="5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe" containerID="01d76150ae7bd344dbfcc885f25c6289879c24907c9ac9d68c081f8edcc8a917" exitCode=0
Jul 06 16:37:46.707241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:46.706862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf" event={"ID":"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe","Type":"ContainerDied","Data":"01d76150ae7bd344dbfcc885f25c6289879c24907c9ac9d68c081f8edcc8a917"}
Jul 06 16:37:49.724162 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:49.724125    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf" event={"ID":"5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe","Type":"ContainerStarted","Data":"cf9cf6d7125eb5de5010c36ebca990ce796bc71d02cc1d9127f86dd01bb1fbe5"}
Jul 06 16:37:49.724645 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:49.724264    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:37:49.744273 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:37:49.744186    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf" podStartSLOduration=2.133468191 podStartE2EDuration="8.744168069s" totalImagesPullingTime="5.505054488s" totalInitContainerRuntime="1.10564539s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:37:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:37:49.742938858 +0000 UTC m=+579.610340088" watchObservedRunningTime="2026-07-06 16:37:49.744168069 +0000 UTC m=+579.611569296"
Jul 06 16:38:00.730849 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:00.730819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-px5gf"
Jul 06 16:38:04.327271 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.327232    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pflnn"]
Jul 06 16:38:04.330505 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.330481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.333445 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.333419    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 16:38:04.333886 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.333861    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-79x76\""
Jul 06 16:38:04.343818 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.343793    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pflnn"]
Jul 06 16:38:04.527464 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.527428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77c99348-d9f3-4fc6-b06f-db701aa287cb-tls-certs\") pod \"model-serving-api-54d89bd5fc-pflnn\" (UID: \"77c99348-d9f3-4fc6-b06f-db701aa287cb\") " pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.527669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.527481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbk8\" (UniqueName: \"kubernetes.io/projected/77c99348-d9f3-4fc6-b06f-db701aa287cb-kube-api-access-gfbk8\") pod \"model-serving-api-54d89bd5fc-pflnn\" (UID: \"77c99348-d9f3-4fc6-b06f-db701aa287cb\") " pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.628303 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.628212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbk8\" (UniqueName: \"kubernetes.io/projected/77c99348-d9f3-4fc6-b06f-db701aa287cb-kube-api-access-gfbk8\") pod \"model-serving-api-54d89bd5fc-pflnn\" (UID: \"77c99348-d9f3-4fc6-b06f-db701aa287cb\") " pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.628303 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.628282    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77c99348-d9f3-4fc6-b06f-db701aa287cb-tls-certs\") pod \"model-serving-api-54d89bd5fc-pflnn\" (UID: \"77c99348-d9f3-4fc6-b06f-db701aa287cb\") " pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.630745 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.630715    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77c99348-d9f3-4fc6-b06f-db701aa287cb-tls-certs\") pod \"model-serving-api-54d89bd5fc-pflnn\" (UID: \"77c99348-d9f3-4fc6-b06f-db701aa287cb\") " pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.644568 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.644536    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbk8\" (UniqueName: \"kubernetes.io/projected/77c99348-d9f3-4fc6-b06f-db701aa287cb-kube-api-access-gfbk8\") pod \"model-serving-api-54d89bd5fc-pflnn\" (UID: \"77c99348-d9f3-4fc6-b06f-db701aa287cb\") " pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:04.942125 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:04.942036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:05.079439 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:05.079407    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pflnn"]
Jul 06 16:38:05.082545 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:38:05.082505    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c99348_d9f3_4fc6_b06f_db701aa287cb.slice/crio-a0103c83357b466001452c940e8068a9c6a8942882de9a2eebdcda30f000f9e1 WatchSource:0}: Error finding container a0103c83357b466001452c940e8068a9c6a8942882de9a2eebdcda30f000f9e1: Status 404 returned error can't find the container with id a0103c83357b466001452c940e8068a9c6a8942882de9a2eebdcda30f000f9e1
Jul 06 16:38:05.790989 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:05.790953    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn" event={"ID":"77c99348-d9f3-4fc6-b06f-db701aa287cb","Type":"ContainerStarted","Data":"a0103c83357b466001452c940e8068a9c6a8942882de9a2eebdcda30f000f9e1"}
Jul 06 16:38:09.808990 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:09.808942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn" event={"ID":"77c99348-d9f3-4fc6-b06f-db701aa287cb","Type":"ContainerStarted","Data":"8eab39b46ad63e91935e3cac66a00f6b3b0e7371c5e6c991d1f87a472541e11b"}
Jul 06 16:38:09.809452 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:09.809034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:09.854075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:09.854017    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn" podStartSLOduration=2.096537098 podStartE2EDuration="5.853999638s" totalImagesPullingTime="3.75746254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:09.853274816 +0000 UTC m=+599.720676057" watchObservedRunningTime="2026-07-06 16:38:09.853999638 +0000 UTC m=+599.721400862"
Jul 06 16:38:10.553672 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:10.553645    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:38:10.553672 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:10.553670    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:38:12.351457 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.351420    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"]
Jul 06 16:38:12.355049 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.355025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.357240 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.357213    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fnk5z\""
Jul 06 16:38:12.357444 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.357221    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 16:38:12.357444 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.357348    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 16:38:12.357764 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.357747    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 16:38:12.367246 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.367217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"]
Jul 06 16:38:12.389487 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389391    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389487 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ab8814-3323-449e-8ead-a354c5f93703-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389487 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ab8814-3323-449e-8ead-a354c5f93703-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389872 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389872 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389872 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7499t\" (UniqueName: \"kubernetes.io/projected/24ab8814-3323-449e-8ead-a354c5f93703-kube-api-access-7499t\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389872 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389872 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ab8814-3323-449e-8ead-a354c5f93703-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.389872 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.389775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490338 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490338 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490334    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490638 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7499t\" (UniqueName: \"kubernetes.io/projected/24ab8814-3323-449e-8ead-a354c5f93703-kube-api-access-7499t\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490638 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490638 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ab8814-3323-449e-8ead-a354c5f93703-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490638 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490446    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490846 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490846 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ab8814-3323-449e-8ead-a354c5f93703-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490846 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ab8814-3323-449e-8ead-a354c5f93703-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.490846 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490825    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.491033 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490950    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.491033 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.490997    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.491101 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.491063    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.491202 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.491182    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24ab8814-3323-449e-8ead-a354c5f93703-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.492767 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.492749    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24ab8814-3323-449e-8ead-a354c5f93703-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.493029 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.493011    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24ab8814-3323-449e-8ead-a354c5f93703-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.500328 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.500299    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7499t\" (UniqueName: \"kubernetes.io/projected/24ab8814-3323-449e-8ead-a354c5f93703-kube-api-access-7499t\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.502565 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.502543    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24ab8814-3323-449e-8ead-a354c5f93703-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l29kk\" (UID: \"24ab8814-3323-449e-8ead-a354c5f93703\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.667132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.667036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:12.826723 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.826539    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"]
Jul 06 16:38:12.829218 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:38:12.829192    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ab8814_3323_449e_8ead_a354c5f93703.slice/crio-dd1ef082d257caff694e3db2b406942bc55dfe871f9277277d020b495f05593c WatchSource:0}: Error finding container dd1ef082d257caff694e3db2b406942bc55dfe871f9277277d020b495f05593c: Status 404 returned error can't find the container with id dd1ef082d257caff694e3db2b406942bc55dfe871f9277277d020b495f05593c
Jul 06 16:38:12.831234 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:12.831216    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:38:13.487324 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.487284    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"]
Jul 06 16:38:13.491710 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.491692    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.494144 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.494125    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kqq9q\""
Jul 06 16:38:13.494899 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.494878    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 16:38:13.495012 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.494940    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 16:38:13.495012 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.494991    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 16:38:13.495127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.495018    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 16:38:13.495127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.495083    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 16:38:13.508369 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.508341    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"]
Jul 06 16:38:13.598753 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.598716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksfs\" (UniqueName: \"kubernetes.io/projected/e1020f17-1d96-491d-8046-0de818b1e7c3-kube-api-access-fksfs\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.598753 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.598767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1020f17-1d96-491d-8046-0de818b1e7c3-metrics-cert\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.599025 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.598845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1020f17-1d96-491d-8046-0de818b1e7c3-manager-config\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.599025 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.598904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1020f17-1d96-491d-8046-0de818b1e7c3-cert\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.700292 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.700247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1020f17-1d96-491d-8046-0de818b1e7c3-manager-config\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.700481 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.700348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1020f17-1d96-491d-8046-0de818b1e7c3-cert\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.700591 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.700555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fksfs\" (UniqueName: \"kubernetes.io/projected/e1020f17-1d96-491d-8046-0de818b1e7c3-kube-api-access-fksfs\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.700759 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.700634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1020f17-1d96-491d-8046-0de818b1e7c3-metrics-cert\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.701492 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.701413    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e1020f17-1d96-491d-8046-0de818b1e7c3-manager-config\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.703772 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.703742    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1020f17-1d96-491d-8046-0de818b1e7c3-metrics-cert\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.704293 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.704272    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1020f17-1d96-491d-8046-0de818b1e7c3-cert\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.715406 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.715379    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksfs\" (UniqueName: \"kubernetes.io/projected/e1020f17-1d96-491d-8046-0de818b1e7c3-kube-api-access-fksfs\") pod \"lws-controller-manager-5db866ddc8-2pwbw\" (UID: \"e1020f17-1d96-491d-8046-0de818b1e7c3\") " pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.808468 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.808387    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:13.827395 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:13.827360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk" event={"ID":"24ab8814-3323-449e-8ead-a354c5f93703","Type":"ContainerStarted","Data":"dd1ef082d257caff694e3db2b406942bc55dfe871f9277277d020b495f05593c"}
Jul 06 16:38:14.066213 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.066182    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"]
Jul 06 16:38:14.068952 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:38:14.068903    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1020f17_1d96_491d_8046_0de818b1e7c3.slice/crio-7210ab74fe866ee66a19cead6880fa5d6b9a18583bd7fbe9369225442876a405 WatchSource:0}: Error finding container 7210ab74fe866ee66a19cead6880fa5d6b9a18583bd7fbe9369225442876a405: Status 404 returned error can't find the container with id 7210ab74fe866ee66a19cead6880fa5d6b9a18583bd7fbe9369225442876a405
Jul 06 16:38:14.073447 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.073418    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"]
Jul 06 16:38:14.077435 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.077413    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.080331 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.080105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 16:38:14.080331 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.080255    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hxrvb\""
Jul 06 16:38:14.087388 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.087359    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"]
Jul 06 16:38:14.091783 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.091708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.092265 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.092083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"]
Jul 06 16:38:14.101771 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.100457    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w5s62\""
Jul 06 16:38:14.101771 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.100937    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 16:38:14.104417 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.104385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c490b0-739f-4688-8c35-e9d09eada6e6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.104573 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.104500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctjjk\" (UniqueName: \"kubernetes.io/projected/eef37e1f-b694-4263-8c1e-917f583cbb43-kube-api-access-ctjjk\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.104573 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.104534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tc84\" (UniqueName: \"kubernetes.io/projected/55c490b0-739f-4688-8c35-e9d09eada6e6-kube-api-access-9tc84\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.104739 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.104573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef37e1f-b694-4263-8c1e-917f583cbb43-cert\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.114960 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.114922    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"]
Jul 06 16:38:14.205555 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.205469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef37e1f-b694-4263-8c1e-917f583cbb43-cert\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.205555 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.205539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c490b0-739f-4688-8c35-e9d09eada6e6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.205833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.205658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctjjk\" (UniqueName: \"kubernetes.io/projected/eef37e1f-b694-4263-8c1e-917f583cbb43-kube-api-access-ctjjk\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.205833 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:38:14.205671    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 06 16:38:14.205833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.205689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tc84\" (UniqueName: \"kubernetes.io/projected/55c490b0-739f-4688-8c35-e9d09eada6e6-kube-api-access-9tc84\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.205833 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:38:14.205699    2582 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 16:38:14.205833 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:38:14.205768    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef37e1f-b694-4263-8c1e-917f583cbb43-cert podName:eef37e1f-b694-4263-8c1e-917f583cbb43 nodeName:}" failed. No retries permitted until 2026-07-06 16:38:14.705743054 +0000 UTC m=+604.573144260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eef37e1f-b694-4263-8c1e-917f583cbb43-cert") pod "kserve-controller-manager-d6f4b65b8-v7fr7" (UID: "eef37e1f-b694-4263-8c1e-917f583cbb43") : secret "kserve-webhook-server-cert" not found
Jul 06 16:38:14.205833 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:38:14.205789    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55c490b0-739f-4688-8c35-e9d09eada6e6-cert podName:55c490b0-739f-4688-8c35-e9d09eada6e6 nodeName:}" failed. No retries permitted until 2026-07-06 16:38:14.705780448 +0000 UTC m=+604.573181661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55c490b0-739f-4688-8c35-e9d09eada6e6-cert") pod "llmisvc-controller-manager-777c6bd7d5-dhrz2" (UID: "55c490b0-739f-4688-8c35-e9d09eada6e6") : secret "llmisvc-webhook-server-cert" not found
Jul 06 16:38:14.216304 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.216271    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tc84\" (UniqueName: \"kubernetes.io/projected/55c490b0-739f-4688-8c35-e9d09eada6e6-kube-api-access-9tc84\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.225467 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.225437    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctjjk\" (UniqueName: \"kubernetes.io/projected/eef37e1f-b694-4263-8c1e-917f583cbb43-kube-api-access-ctjjk\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.712061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.711995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c490b0-739f-4688-8c35-e9d09eada6e6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.712559 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.712197    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef37e1f-b694-4263-8c1e-917f583cbb43-cert\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.714925 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.714890    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eef37e1f-b694-4263-8c1e-917f583cbb43-cert\") pod \"kserve-controller-manager-d6f4b65b8-v7fr7\" (UID: \"eef37e1f-b694-4263-8c1e-917f583cbb43\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:14.715075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.715023    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c490b0-739f-4688-8c35-e9d09eada6e6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dhrz2\" (UID: \"55c490b0-739f-4688-8c35-e9d09eada6e6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:14.836675 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.836635    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw" event={"ID":"e1020f17-1d96-491d-8046-0de818b1e7c3","Type":"ContainerStarted","Data":"7210ab74fe866ee66a19cead6880fa5d6b9a18583bd7fbe9369225442876a405"}
Jul 06 16:38:14.991986 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:14.991944    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:15.007806 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:15.007529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:17.205650 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.205580    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:38:17.206120 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.205709    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:38:17.206120 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.205769    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:38:17.376962 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.376924    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"]
Jul 06 16:38:17.381320 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:38:17.381259    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef37e1f_b694_4263_8c1e_917f583cbb43.slice/crio-67f6281f540582b59d20b6f177145dff86efd782db72c78761e48d763ad211f1 WatchSource:0}: Error finding container 67f6281f540582b59d20b6f177145dff86efd782db72c78761e48d763ad211f1: Status 404 returned error can't find the container with id 67f6281f540582b59d20b6f177145dff86efd782db72c78761e48d763ad211f1
Jul 06 16:38:17.393365 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.393327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"]
Jul 06 16:38:17.398248 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:38:17.398214    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55c490b0_739f_4688_8c35_e9d09eada6e6.slice/crio-7ca2d8c1660bfc4a702ed64114e679cefd99e98018ba106072d0b68995356582 WatchSource:0}: Error finding container 7ca2d8c1660bfc4a702ed64114e679cefd99e98018ba106072d0b68995356582: Status 404 returned error can't find the container with id 7ca2d8c1660bfc4a702ed64114e679cefd99e98018ba106072d0b68995356582
Jul 06 16:38:17.852990 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.852956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2" event={"ID":"55c490b0-739f-4688-8c35-e9d09eada6e6","Type":"ContainerStarted","Data":"7ca2d8c1660bfc4a702ed64114e679cefd99e98018ba106072d0b68995356582"}
Jul 06 16:38:17.854437 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.854405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk" event={"ID":"24ab8814-3323-449e-8ead-a354c5f93703","Type":"ContainerStarted","Data":"54ae458850dac54293f429cf46f44c2f1b0049dd0b5490de31545968ff5475b6"}
Jul 06 16:38:17.855840 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.855815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw" event={"ID":"e1020f17-1d96-491d-8046-0de818b1e7c3","Type":"ContainerStarted","Data":"8793ea06bcdbff19d0c24d82a2bd54375df55410a89f51e5e52baccde7da15d7"}
Jul 06 16:38:17.855973 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.855873    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:17.856910 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.856889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7" event={"ID":"eef37e1f-b694-4263-8c1e-917f583cbb43","Type":"ContainerStarted","Data":"67f6281f540582b59d20b6f177145dff86efd782db72c78761e48d763ad211f1"}
Jul 06 16:38:17.875082 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.875027    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk" podStartSLOduration=1.501169847 podStartE2EDuration="5.875009899s" totalImagesPullingTime="4.373840052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:17.874260974 +0000 UTC m=+607.741662203" watchObservedRunningTime="2026-07-06 16:38:17.875009899 +0000 UTC m=+607.742411126"
Jul 06 16:38:17.889404 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:17.889349    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw" podStartSLOduration=1.693030511 podStartE2EDuration="4.889330313s" totalImagesPullingTime="3.196299802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:17.888212994 +0000 UTC m=+607.755614221" watchObservedRunningTime="2026-07-06 16:38:17.889330313 +0000 UTC m=+607.756731543"
Jul 06 16:38:18.667387 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:18.667340    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:18.673544 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:18.673515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:18.861527 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:18.861479    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:18.862463 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:18.862439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l29kk"
Jul 06 16:38:20.818379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:20.818330    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pflnn"
Jul 06 16:38:21.877159 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:21.877104    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2" event={"ID":"55c490b0-739f-4688-8c35-e9d09eada6e6","Type":"ContainerStarted","Data":"05da7c0d197a3d02a08523bbbbb578d82476a27ebb565577503062162994fde8"}
Jul 06 16:38:21.877684 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:21.877211    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:21.892792 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:21.892737    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2" podStartSLOduration=4.198438058 podStartE2EDuration="7.892719769s" totalImagesPullingTime="3.694281711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:21.892352419 +0000 UTC m=+611.759753649" watchObservedRunningTime="2026-07-06 16:38:21.892719769 +0000 UTC m=+611.760121034"
Jul 06 16:38:23.890311 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:23.890266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7" event={"ID":"eef37e1f-b694-4263-8c1e-917f583cbb43","Type":"ContainerStarted","Data":"65257b1215b773a147114add2352ab74d190421322233a0ea0013acdc9c3c0d3"}
Jul 06 16:38:23.890714 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:23.890370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:38:23.909920 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:23.909870    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7" podStartSLOduration=4.159767568 podStartE2EDuration="9.909852096s" totalImagesPullingTime="5.750084528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:23.908401845 +0000 UTC m=+613.775803073" watchObservedRunningTime="2026-07-06 16:38:23.909852096 +0000 UTC m=+613.777253323"
Jul 06 16:38:28.863914 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:28.863877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5db866ddc8-2pwbw"
Jul 06 16:38:52.885211 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:52.885179    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dhrz2"
Jul 06 16:38:54.900035 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:38:54.899998    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-v7fr7"
Jul 06 16:39:04.171396 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.171353    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hgzw"]
Jul 06 16:39:04.180623 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.180537    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:04.182967 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.182936    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 16:39:04.183323 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.183083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hgzw"]
Jul 06 16:39:04.183638 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.183587    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 16:39:04.183834 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.183817    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rhkxg\""
Jul 06 16:39:04.280108 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.280065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hljn\" (UniqueName: \"kubernetes.io/projected/a1f6a2d3-0751-45e4-b62d-17ea545e1472-kube-api-access-8hljn\") pod \"kuadrant-operator-catalog-4hgzw\" (UID: \"a1f6a2d3-0751-45e4-b62d-17ea545e1472\") " pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:04.381211 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.381168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hljn\" (UniqueName: \"kubernetes.io/projected/a1f6a2d3-0751-45e4-b62d-17ea545e1472-kube-api-access-8hljn\") pod \"kuadrant-operator-catalog-4hgzw\" (UID: \"a1f6a2d3-0751-45e4-b62d-17ea545e1472\") " pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:04.388965 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.388938    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hljn\" (UniqueName: \"kubernetes.io/projected/a1f6a2d3-0751-45e4-b62d-17ea545e1472-kube-api-access-8hljn\") pod \"kuadrant-operator-catalog-4hgzw\" (UID: \"a1f6a2d3-0751-45e4-b62d-17ea545e1472\") " pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:04.491359 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.491322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:04.627982 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.627954    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hgzw"]
Jul 06 16:39:04.630269 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:39:04.630234    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f6a2d3_0751_45e4_b62d_17ea545e1472.slice/crio-b506e3659815da7ca86940e415e1596d272cf42f571f5de6836e42476f5aa96e WatchSource:0}: Error finding container b506e3659815da7ca86940e415e1596d272cf42f571f5de6836e42476f5aa96e: Status 404 returned error can't find the container with id b506e3659815da7ca86940e415e1596d272cf42f571f5de6836e42476f5aa96e
Jul 06 16:39:04.700192 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:04.700156    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hgzw"]
Jul 06 16:39:05.066844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:05.066806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw" event={"ID":"a1f6a2d3-0751-45e4-b62d-17ea545e1472","Type":"ContainerStarted","Data":"b506e3659815da7ca86940e415e1596d272cf42f571f5de6836e42476f5aa96e"}
Jul 06 16:39:08.082493 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.082457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw" event={"ID":"a1f6a2d3-0751-45e4-b62d-17ea545e1472","Type":"ContainerStarted","Data":"5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571"}
Jul 06 16:39:08.082998 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.082534    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw" podUID="a1f6a2d3-0751-45e4-b62d-17ea545e1472" containerName="registry-server" containerID="cri-o://5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571" gracePeriod=2
Jul 06 16:39:08.097115 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.097072    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw" podStartSLOduration=1.519158412 podStartE2EDuration="4.097054366s" totalImagesPullingTime="2.577895954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:08.095477098 +0000 UTC m=+657.962878328" watchObservedRunningTime="2026-07-06 16:39:08.097054366 +0000 UTC m=+657.964455594"
Jul 06 16:39:08.335107 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.335043    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:08.418712 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.418679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hljn\" (UniqueName: \"kubernetes.io/projected/a1f6a2d3-0751-45e4-b62d-17ea545e1472-kube-api-access-8hljn\") pod \"a1f6a2d3-0751-45e4-b62d-17ea545e1472\" (UID: \"a1f6a2d3-0751-45e4-b62d-17ea545e1472\") "
Jul 06 16:39:08.420924 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.420884    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f6a2d3-0751-45e4-b62d-17ea545e1472-kube-api-access-8hljn" (OuterVolumeSpecName: "kube-api-access-8hljn") pod "a1f6a2d3-0751-45e4-b62d-17ea545e1472" (UID: "a1f6a2d3-0751-45e4-b62d-17ea545e1472"). InnerVolumeSpecName "kube-api-access-8hljn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:39:08.519627 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:08.519567    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hljn\" (UniqueName: \"kubernetes.io/projected/a1f6a2d3-0751-45e4-b62d-17ea545e1472-kube-api-access-8hljn\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:39:09.087944 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.087905    2582 generic.go:356] "Generic (PLEG): container finished" podID="a1f6a2d3-0751-45e4-b62d-17ea545e1472" containerID="5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571" exitCode=0
Jul 06 16:39:09.088414 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.087953    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw"
Jul 06 16:39:09.088414 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.087997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw" event={"ID":"a1f6a2d3-0751-45e4-b62d-17ea545e1472","Type":"ContainerDied","Data":"5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571"}
Jul 06 16:39:09.088414 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.088058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4hgzw" event={"ID":"a1f6a2d3-0751-45e4-b62d-17ea545e1472","Type":"ContainerDied","Data":"b506e3659815da7ca86940e415e1596d272cf42f571f5de6836e42476f5aa96e"}
Jul 06 16:39:09.088414 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.088088    2582 scope.go:117] "RemoveContainer" containerID="5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571"
Jul 06 16:39:09.097701 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.097675    2582 scope.go:117] "RemoveContainer" containerID="5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571"
Jul 06 16:39:09.098024 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:39:09.098000    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571\": container with ID starting with 5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571 not found: ID does not exist" containerID="5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571"
Jul 06 16:39:09.098075 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.098035    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571"} err="failed to get container status \"5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571\": rpc error: code = NotFound desc = could not find container \"5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571\": container with ID starting with 5521d409ab2fe83094e8977814430e22aa5b10b42df96269f8caba3007c80571 not found: ID does not exist"
Jul 06 16:39:09.102917 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.102887    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hgzw"]
Jul 06 16:39:09.108742 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:09.108716    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4hgzw"]
Jul 06 16:39:10.645865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:10.645831    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1f6a2d3-0751-45e4-b62d-17ea545e1472" path="/var/lib/kubelet/pods/a1f6a2d3-0751-45e4-b62d-17ea545e1472/volumes"
Jul 06 16:39:40.241231 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.241193    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"]
Jul 06 16:39:40.241641 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.241534    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f6a2d3-0751-45e4-b62d-17ea545e1472" containerName="registry-server"
Jul 06 16:39:40.241641 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.241545    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f6a2d3-0751-45e4-b62d-17ea545e1472" containerName="registry-server"
Jul 06 16:39:40.241641 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.241595    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f6a2d3-0751-45e4-b62d-17ea545e1472" containerName="registry-server"
Jul 06 16:39:40.244053 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.244034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:40.246703 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.246675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xfwr5\""
Jul 06 16:39:40.247462 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.247445    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 16:39:40.247541 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.247446    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 16:39:40.256739 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.256710    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"]
Jul 06 16:39:40.300764 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.300725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-586p4\" (UniqueName: \"kubernetes.io/projected/fab098d3-c345-4104-ae4a-7f062efd2dc6-kube-api-access-586p4\") pod \"limitador-operator-controller-manager-859d7b78bd-tp62c\" (UID: \"fab098d3-c345-4104-ae4a-7f062efd2dc6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:40.401318 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.401280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-586p4\" (UniqueName: \"kubernetes.io/projected/fab098d3-c345-4104-ae4a-7f062efd2dc6-kube-api-access-586p4\") pod \"limitador-operator-controller-manager-859d7b78bd-tp62c\" (UID: \"fab098d3-c345-4104-ae4a-7f062efd2dc6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:40.414372 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.414339    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-586p4\" (UniqueName: \"kubernetes.io/projected/fab098d3-c345-4104-ae4a-7f062efd2dc6-kube-api-access-586p4\") pod \"limitador-operator-controller-manager-859d7b78bd-tp62c\" (UID: \"fab098d3-c345-4104-ae4a-7f062efd2dc6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:40.554496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.554400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:40.714557 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:40.714523    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"]
Jul 06 16:39:40.717510 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:39:40.717480    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab098d3_c345_4104_ae4a_7f062efd2dc6.slice/crio-aefed352ca04dc7ff71b9aadff1fefc826359a8f4f3dd9d95bd960bd9c8c328f WatchSource:0}: Error finding container aefed352ca04dc7ff71b9aadff1fefc826359a8f4f3dd9d95bd960bd9c8c328f: Status 404 returned error can't find the container with id aefed352ca04dc7ff71b9aadff1fefc826359a8f4f3dd9d95bd960bd9c8c328f
Jul 06 16:39:41.231545 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:41.231515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c" event={"ID":"fab098d3-c345-4104-ae4a-7f062efd2dc6","Type":"ContainerStarted","Data":"aefed352ca04dc7ff71b9aadff1fefc826359a8f4f3dd9d95bd960bd9c8c328f"}
Jul 06 16:39:43.245953 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:43.245916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c" event={"ID":"fab098d3-c345-4104-ae4a-7f062efd2dc6","Type":"ContainerStarted","Data":"70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2"}
Jul 06 16:39:43.246476 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:43.246114    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:43.264716 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:43.264657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c" podStartSLOduration=1.073845545 podStartE2EDuration="3.264638471s" totalImagesPullingTime="2.190792926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:43.26276042 +0000 UTC m=+693.130161649" watchObservedRunningTime="2026-07-06 16:39:43.264638471 +0000 UTC m=+693.132039699"
Jul 06 16:39:47.858281 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:47.858246    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"]
Jul 06 16:39:47.865664 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:47.865629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:39:47.867680 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:47.867653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 16:39:47.867824 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:47.867747    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9glt8\""
Jul 06 16:39:47.873435 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:47.873408    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"]
Jul 06 16:39:47.968254 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:47.968211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnlct\" (UniqueName: \"kubernetes.io/projected/8255c0f6-3493-425b-9652-2d961fbc57a7-kube-api-access-gnlct\") pod \"dns-operator-controller-manager-864dd78c4c-knpbt\" (UID: \"8255c0f6-3493-425b-9652-2d961fbc57a7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:39:48.068826 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:48.068782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnlct\" (UniqueName: \"kubernetes.io/projected/8255c0f6-3493-425b-9652-2d961fbc57a7-kube-api-access-gnlct\") pod \"dns-operator-controller-manager-864dd78c4c-knpbt\" (UID: \"8255c0f6-3493-425b-9652-2d961fbc57a7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:39:48.079450 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:48.079410    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnlct\" (UniqueName: \"kubernetes.io/projected/8255c0f6-3493-425b-9652-2d961fbc57a7-kube-api-access-gnlct\") pod \"dns-operator-controller-manager-864dd78c4c-knpbt\" (UID: \"8255c0f6-3493-425b-9652-2d961fbc57a7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:39:48.177419 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:48.177321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:39:48.318136 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:48.318107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"]
Jul 06 16:39:48.321390 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:39:48.321365    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8255c0f6_3493_425b_9652_2d961fbc57a7.slice/crio-aa0c137aab35b9b64c2006621bbe96acc9e615ca30880af314d97696aad71051 WatchSource:0}: Error finding container aa0c137aab35b9b64c2006621bbe96acc9e615ca30880af314d97696aad71051: Status 404 returned error can't find the container with id aa0c137aab35b9b64c2006621bbe96acc9e615ca30880af314d97696aad71051
Jul 06 16:39:49.285211 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:49.285170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt" event={"ID":"8255c0f6-3493-425b-9652-2d961fbc57a7","Type":"ContainerStarted","Data":"aa0c137aab35b9b64c2006621bbe96acc9e615ca30880af314d97696aad71051"}
Jul 06 16:39:51.295887 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:51.295847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt" event={"ID":"8255c0f6-3493-425b-9652-2d961fbc57a7","Type":"ContainerStarted","Data":"d1f53d61b471dc476523667854af6c7444fc15d0e5b385d12ec071277069b12b"}
Jul 06 16:39:51.296324 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:51.295959    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:39:51.313004 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:51.312952    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt" podStartSLOduration=1.929657317 podStartE2EDuration="4.312936582s" totalImagesPullingTime="2.383279265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:51.31104551 +0000 UTC m=+701.178446738" watchObservedRunningTime="2026-07-06 16:39:51.312936582 +0000 UTC m=+701.180337809"
Jul 06 16:39:54.252903 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:54.252868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:39:55.574382 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.574338    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"]
Jul 06 16:39:55.576965 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.576940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.578994 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.578968    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 16:39:55.579402 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.579377    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c9sg5\""
Jul 06 16:39:55.579513 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.579382    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 16:39:55.589267 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.589241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"]
Jul 06 16:39:55.643436 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.643405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb5bk\" (UniqueName: \"kubernetes.io/projected/6e78e8b8-5391-4706-864a-52384cb014c0-kube-api-access-fb5bk\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.643620 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.643453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e78e8b8-5391-4706-864a-52384cb014c0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.643620 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.643481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e78e8b8-5391-4706-864a-52384cb014c0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.744753 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.744719    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb5bk\" (UniqueName: \"kubernetes.io/projected/6e78e8b8-5391-4706-864a-52384cb014c0-kube-api-access-fb5bk\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.744925 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.744780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e78e8b8-5391-4706-864a-52384cb014c0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.744925 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.744810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e78e8b8-5391-4706-864a-52384cb014c0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.745003 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:39:55.744934    2582 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 06 16:39:55.745037 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:39:55.745016    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e78e8b8-5391-4706-864a-52384cb014c0-plugin-serving-cert podName:6e78e8b8-5391-4706-864a-52384cb014c0 nodeName:}" failed. No retries permitted until 2026-07-06 16:39:56.244994954 +0000 UTC m=+706.112396175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6e78e8b8-5391-4706-864a-52384cb014c0-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-hlfdb" (UID: "6e78e8b8-5391-4706-864a-52384cb014c0") : secret "plugin-serving-cert" not found
Jul 06 16:39:55.745516 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.745496    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e78e8b8-5391-4706-864a-52384cb014c0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:55.753934 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:55.753899    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb5bk\" (UniqueName: \"kubernetes.io/projected/6e78e8b8-5391-4706-864a-52384cb014c0-kube-api-access-fb5bk\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:56.250071 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:56.250029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e78e8b8-5391-4706-864a-52384cb014c0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:56.252613 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:56.252576    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e78e8b8-5391-4706-864a-52384cb014c0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hlfdb\" (UID: \"6e78e8b8-5391-4706-864a-52384cb014c0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:56.486584 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:56.486544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"
Jul 06 16:39:56.626411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:56.626383    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb"]
Jul 06 16:39:56.628802 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:39:56.628771    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e78e8b8_5391_4706_864a_52384cb014c0.slice/crio-3198df9e94412b6954d1f361cfcf0824fb72d9e5018bc7c6e3d9a7b0d46ca934 WatchSource:0}: Error finding container 3198df9e94412b6954d1f361cfcf0824fb72d9e5018bc7c6e3d9a7b0d46ca934: Status 404 returned error can't find the container with id 3198df9e94412b6954d1f361cfcf0824fb72d9e5018bc7c6e3d9a7b0d46ca934
Jul 06 16:39:57.327042 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:39:57.327000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb" event={"ID":"6e78e8b8-5391-4706-864a-52384cb014c0","Type":"ContainerStarted","Data":"3198df9e94412b6954d1f361cfcf0824fb72d9e5018bc7c6e3d9a7b0d46ca934"}
Jul 06 16:40:02.303680 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:02.303455    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-knpbt"
Jul 06 16:40:05.394127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.394086    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"]
Jul 06 16:40:05.397571 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.397552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.399923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.399901    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nbnjh\""
Jul 06 16:40:05.408852 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.408825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"]
Jul 06 16:40:05.539017 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.538978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5wk\" (UniqueName: \"kubernetes.io/projected/579f06cb-d420-49f2-9730-eb3e3a9ae680-kube-api-access-pd5wk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.539218 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.539033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/579f06cb-d420-49f2-9730-eb3e3a9ae680-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.640056 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.640013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/579f06cb-d420-49f2-9730-eb3e3a9ae680-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.640268 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.640138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5wk\" (UniqueName: \"kubernetes.io/projected/579f06cb-d420-49f2-9730-eb3e3a9ae680-kube-api-access-pd5wk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.640431 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.640408    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/579f06cb-d420-49f2-9730-eb3e3a9ae680-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.652241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.652171    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5wk\" (UniqueName: \"kubernetes.io/projected/579f06cb-d420-49f2-9730-eb3e3a9ae680-kube-api-access-pd5wk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.708551 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.708518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:05.870344 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:05.870307    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"]
Jul 06 16:40:05.874813 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:40:05.874784    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579f06cb_d420_49f2_9730_eb3e3a9ae680.slice/crio-7d4d00f4fa37e485a05404bce9bce7f5a94b5dba8b09dad511cdab383d96825d WatchSource:0}: Error finding container 7d4d00f4fa37e485a05404bce9bce7f5a94b5dba8b09dad511cdab383d96825d: Status 404 returned error can't find the container with id 7d4d00f4fa37e485a05404bce9bce7f5a94b5dba8b09dad511cdab383d96825d
Jul 06 16:40:06.037840 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.037805    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"]
Jul 06 16:40:06.045784 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.045753    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"]
Jul 06 16:40:06.063260 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.063224    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"]
Jul 06 16:40:06.068032 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.068009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.076985 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.076958    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"]
Jul 06 16:40:06.077202 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.077177    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" containerName="manager" containerID="cri-o://70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2" gracePeriod=2
Jul 06 16:40:06.081669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.081647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"]
Jul 06 16:40:06.089499 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.089466    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"]
Jul 06 16:40:06.101294 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:06.101253    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tp62c\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:40:06.110773 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.110741    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"]
Jul 06 16:40:06.111191 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.111172    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" containerName="manager"
Jul 06 16:40:06.111287 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.111194    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" containerName="manager"
Jul 06 16:40:06.111287 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.111284    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" containerName="manager"
Jul 06 16:40:06.114205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.114182    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:06.116784 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:06.116753    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tp62c\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:40:06.128369 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.128337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"]
Jul 06 16:40:06.245575 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.245535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a972bd42-3c52-4233-b224-60e5fabe45bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2ltxz\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.245789 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.245705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpvq\" (UniqueName: \"kubernetes.io/projected/f3af711d-91a3-4b08-a5ba-9df27a2a832b-kube-api-access-4cpvq\") pod \"limitador-operator-controller-manager-859d7b78bd-rsm9v\" (UID: \"f3af711d-91a3-4b08-a5ba-9df27a2a832b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:06.245857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.245785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlt86\" (UniqueName: \"kubernetes.io/projected/a972bd42-3c52-4233-b224-60e5fabe45bb-kube-api-access-wlt86\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2ltxz\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.319694 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.319632    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:40:06.321693 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:06.321661    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tp62c\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:40:06.347127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.347087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpvq\" (UniqueName: \"kubernetes.io/projected/f3af711d-91a3-4b08-a5ba-9df27a2a832b-kube-api-access-4cpvq\") pod \"limitador-operator-controller-manager-859d7b78bd-rsm9v\" (UID: \"f3af711d-91a3-4b08-a5ba-9df27a2a832b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:06.347300 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.347134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlt86\" (UniqueName: \"kubernetes.io/projected/a972bd42-3c52-4233-b224-60e5fabe45bb-kube-api-access-wlt86\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2ltxz\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.347300 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.347193    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a972bd42-3c52-4233-b224-60e5fabe45bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2ltxz\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.347712 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.347689    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a972bd42-3c52-4233-b224-60e5fabe45bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2ltxz\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.359001 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.358966    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlt86\" (UniqueName: \"kubernetes.io/projected/a972bd42-3c52-4233-b224-60e5fabe45bb-kube-api-access-wlt86\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-2ltxz\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.359001 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.358998    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpvq\" (UniqueName: \"kubernetes.io/projected/f3af711d-91a3-4b08-a5ba-9df27a2a832b-kube-api-access-4cpvq\") pod \"limitador-operator-controller-manager-859d7b78bd-rsm9v\" (UID: \"f3af711d-91a3-4b08-a5ba-9df27a2a832b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:06.379586 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.379548    2582 generic.go:356] "Generic (PLEG): container finished" podID="fab098d3-c345-4104-ae4a-7f062efd2dc6" containerID="70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2" exitCode=0
Jul 06 16:40:06.379848 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.379625    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:40:06.379848 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.379751    2582 scope.go:117] "RemoveContainer" containerID="70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2"
Jul 06 16:40:06.380563 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.380446    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:06.381751 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:06.381721    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tp62c\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tp62c"
Jul 06 16:40:06.392346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.392323    2582 scope.go:117] "RemoveContainer" containerID="70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2"
Jul 06 16:40:06.392752 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:06.392730    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2\": container with ID starting with 70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2 not found: ID does not exist" containerID="70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2"
Jul 06 16:40:06.392844 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.392765    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2"} err="failed to get container status \"70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2\": rpc error: code = NotFound desc = could not find container \"70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2\": container with ID starting with 70105162c91b30fb60e7125dcf5fa11011338ffcdcd80ec2767865f3dbc950d2 not found: ID does not exist"
Jul 06 16:40:06.448668 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.448632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-586p4\" (UniqueName: \"kubernetes.io/projected/fab098d3-c345-4104-ae4a-7f062efd2dc6-kube-api-access-586p4\") pod \"fab098d3-c345-4104-ae4a-7f062efd2dc6\" (UID: \"fab098d3-c345-4104-ae4a-7f062efd2dc6\") "
Jul 06 16:40:06.451589 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.451530    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fab098d3-c345-4104-ae4a-7f062efd2dc6-kube-api-access-586p4" (OuterVolumeSpecName: "kube-api-access-586p4") pod "fab098d3-c345-4104-ae4a-7f062efd2dc6" (UID: "fab098d3-c345-4104-ae4a-7f062efd2dc6"). InnerVolumeSpecName "kube-api-access-586p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:40:06.459671 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.459639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:06.549803 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.549761    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-586p4\" (UniqueName: \"kubernetes.io/projected/fab098d3-c345-4104-ae4a-7f062efd2dc6-kube-api-access-586p4\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:40:06.576372 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.576334    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"]
Jul 06 16:40:06.579173 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:40:06.579129    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda972bd42_3c52_4233_b224_60e5fabe45bb.slice/crio-c8781914e609465f657c2218a43896850bf66c2770eace16b78b6ae735749aae WatchSource:0}: Error finding container c8781914e609465f657c2218a43896850bf66c2770eace16b78b6ae735749aae: Status 404 returned error can't find the container with id c8781914e609465f657c2218a43896850bf66c2770eace16b78b6ae735749aae
Jul 06 16:40:06.637489 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.637465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"]
Jul 06 16:40:06.640317 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:40:06.640288    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3af711d_91a3_4b08_a5ba_9df27a2a832b.slice/crio-7535911f54d0653cc6400fe4555cae93e7cbbbd20babb31c030790e5705f840e WatchSource:0}: Error finding container 7535911f54d0653cc6400fe4555cae93e7cbbbd20babb31c030790e5705f840e: Status 404 returned error can't find the container with id 7535911f54d0653cc6400fe4555cae93e7cbbbd20babb31c030790e5705f840e
Jul 06 16:40:06.646744 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:06.646718    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fab098d3-c345-4104-ae4a-7f062efd2dc6" path="/var/lib/kubelet/pods/fab098d3-c345-4104-ae4a-7f062efd2dc6/volumes"
Jul 06 16:40:07.391038 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:07.390999    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v" event={"ID":"f3af711d-91a3-4b08-a5ba-9df27a2a832b","Type":"ContainerStarted","Data":"64f3697d7baf4433984568e5cc6d9dd2e33991edfbef6c6d8eba5a878205a3fe"}
Jul 06 16:40:07.391228 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:07.391063    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v" event={"ID":"f3af711d-91a3-4b08-a5ba-9df27a2a832b","Type":"ContainerStarted","Data":"7535911f54d0653cc6400fe4555cae93e7cbbbd20babb31c030790e5705f840e"}
Jul 06 16:40:07.391228 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:07.391092    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:07.393137 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:07.393073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz" event={"ID":"a972bd42-3c52-4233-b224-60e5fabe45bb","Type":"ContainerStarted","Data":"c8781914e609465f657c2218a43896850bf66c2770eace16b78b6ae735749aae"}
Jul 06 16:40:07.411362 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:07.411281    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v" podStartSLOduration=1.411262787 podStartE2EDuration="1.411262787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:07.409676865 +0000 UTC m=+717.277078094" watchObservedRunningTime="2026-07-06 16:40:07.411262787 +0000 UTC m=+717.278664017"
Jul 06 16:40:18.403471 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:18.403432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rsm9v"
Jul 06 16:40:25.493379 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:25.493325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb" event={"ID":"6e78e8b8-5391-4706-864a-52384cb014c0","Type":"ContainerStarted","Data":"fe9894d4c76d534cee0d34aba26464aedc003f1bfc0f3a19335cd26235dabda5"}
Jul 06 16:40:25.495119 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:25.495068    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" containerName="manager" containerID="cri-o://0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b" gracePeriod=2
Jul 06 16:40:25.496681 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:25.496657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz" event={"ID":"a972bd42-3c52-4233-b224-60e5fabe45bb","Type":"ContainerStarted","Data":"d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b"}
Jul 06 16:40:25.496798 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:25.496784    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:25.509962 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:25.509912    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hlfdb" podStartSLOduration=2.700611548 podStartE2EDuration="30.509898909s" totalImagesPullingTime="27.809287361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:25.509744646 +0000 UTC m=+735.377145874" watchObservedRunningTime="2026-07-06 16:40:25.509898909 +0000 UTC m=+735.377300127"
Jul 06 16:40:25.534418 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:25.534369    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:25.534870 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:25.534829    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz" podStartSLOduration=1.691010723 podStartE2EDuration="19.534814269s" totalImagesPullingTime="17.843803546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:25.532836446 +0000 UTC m=+735.400237674" watchObservedRunningTime="2026-07-06 16:40:25.534814269 +0000 UTC m=+735.402215498"
Jul 06 16:40:26.230205 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.230176    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:26.231957 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:26.231930    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:26.337509 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.337468    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd5wk\" (UniqueName: \"kubernetes.io/projected/579f06cb-d420-49f2-9730-eb3e3a9ae680-kube-api-access-pd5wk\") pod \"579f06cb-d420-49f2-9730-eb3e3a9ae680\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") "
Jul 06 16:40:26.337509 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.337515    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/579f06cb-d420-49f2-9730-eb3e3a9ae680-extensions-socket-volume\") pod \"579f06cb-d420-49f2-9730-eb3e3a9ae680\" (UID: \"579f06cb-d420-49f2-9730-eb3e3a9ae680\") "
Jul 06 16:40:26.337878 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.337845    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f06cb-d420-49f2-9730-eb3e3a9ae680-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "579f06cb-d420-49f2-9730-eb3e3a9ae680" (UID: "579f06cb-d420-49f2-9730-eb3e3a9ae680"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:40:26.339640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.339621    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579f06cb-d420-49f2-9730-eb3e3a9ae680-kube-api-access-pd5wk" (OuterVolumeSpecName: "kube-api-access-pd5wk") pod "579f06cb-d420-49f2-9730-eb3e3a9ae680" (UID: "579f06cb-d420-49f2-9730-eb3e3a9ae680"). InnerVolumeSpecName "kube-api-access-pd5wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:40:26.438440 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.438344    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd5wk\" (UniqueName: \"kubernetes.io/projected/579f06cb-d420-49f2-9730-eb3e3a9ae680-kube-api-access-pd5wk\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:40:26.438440 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.438378    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/579f06cb-d420-49f2-9730-eb3e3a9ae680-extensions-socket-volume\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:40:26.503909 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.503864    2582 generic.go:356] "Generic (PLEG): container finished" podID="579f06cb-d420-49f2-9730-eb3e3a9ae680" containerID="0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b" exitCode=2
Jul 06 16:40:26.509639 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.504806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:26.509639 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.504872    2582 scope.go:117] "RemoveContainer" containerID="0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b"
Jul 06 16:40:26.509639 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:26.507182    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:26.515033 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.515010    2582 scope.go:117] "RemoveContainer" containerID="0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b"
Jul 06 16:40:26.515432 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:26.515401    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b\": container with ID starting with 0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b not found: ID does not exist" containerID="0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b"
Jul 06 16:40:26.515508 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.515443    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b"} err="failed to get container status \"0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b\": rpc error: code = NotFound desc = could not find container \"0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b\": container with ID starting with 0c6ea87ec335a1a44ca00d6a049e5cdc69ddf1f183cd774669ba4eda5f61310b not found: ID does not exist"
Jul 06 16:40:26.517373 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:26.517353    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9rhkm\" is forbidden: User \"system:node:ip-10-0-138-170.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-170.ec2.internal' and this object" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9rhkm"
Jul 06 16:40:26.645831 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:26.645800    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" path="/var/lib/kubelet/pods/579f06cb-d420-49f2-9730-eb3e3a9ae680/volumes"
Jul 06 16:40:36.507469 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:36.507438    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:48.446963 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:48.446925    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"]
Jul 06 16:40:48.447398 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:48.447163    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz" podUID="a972bd42-3c52-4233-b224-60e5fabe45bb" containerName="manager" containerID="cri-o://d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b" gracePeriod=10
Jul 06 16:40:49.214909 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.214876    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:49.342690 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.342561    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlt86\" (UniqueName: \"kubernetes.io/projected/a972bd42-3c52-4233-b224-60e5fabe45bb-kube-api-access-wlt86\") pod \"a972bd42-3c52-4233-b224-60e5fabe45bb\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") "
Jul 06 16:40:49.342690 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.342658    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a972bd42-3c52-4233-b224-60e5fabe45bb-extensions-socket-volume\") pod \"a972bd42-3c52-4233-b224-60e5fabe45bb\" (UID: \"a972bd42-3c52-4233-b224-60e5fabe45bb\") "
Jul 06 16:40:49.343172 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.343147    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a972bd42-3c52-4233-b224-60e5fabe45bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a972bd42-3c52-4233-b224-60e5fabe45bb" (UID: "a972bd42-3c52-4233-b224-60e5fabe45bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:40:49.344865 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.344840    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a972bd42-3c52-4233-b224-60e5fabe45bb-kube-api-access-wlt86" (OuterVolumeSpecName: "kube-api-access-wlt86") pod "a972bd42-3c52-4233-b224-60e5fabe45bb" (UID: "a972bd42-3c52-4233-b224-60e5fabe45bb"). InnerVolumeSpecName "kube-api-access-wlt86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:40:49.443355 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.443309    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlt86\" (UniqueName: \"kubernetes.io/projected/a972bd42-3c52-4233-b224-60e5fabe45bb-kube-api-access-wlt86\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:40:49.443355 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.443343    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a972bd42-3c52-4233-b224-60e5fabe45bb-extensions-socket-volume\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:40:49.616781 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.616699    2582 generic.go:356] "Generic (PLEG): container finished" podID="a972bd42-3c52-4233-b224-60e5fabe45bb" containerID="d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b" exitCode=0
Jul 06 16:40:49.616781 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.616751    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"
Jul 06 16:40:49.617218 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.616786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz" event={"ID":"a972bd42-3c52-4233-b224-60e5fabe45bb","Type":"ContainerDied","Data":"d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b"}
Jul 06 16:40:49.617218 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.616844    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz" event={"ID":"a972bd42-3c52-4233-b224-60e5fabe45bb","Type":"ContainerDied","Data":"c8781914e609465f657c2218a43896850bf66c2770eace16b78b6ae735749aae"}
Jul 06 16:40:49.617218 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.616876    2582 scope.go:117] "RemoveContainer" containerID="d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b"
Jul 06 16:40:49.625527 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.625507    2582 scope.go:117] "RemoveContainer" containerID="d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b"
Jul 06 16:40:49.625833 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:40:49.625811    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b\": container with ID starting with d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b not found: ID does not exist" containerID="d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b"
Jul 06 16:40:49.625914 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.625846    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b"} err="failed to get container status \"d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b\": rpc error: code = NotFound desc = could not find container \"d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b\": container with ID starting with d4809edd0b7f40fb4eb4aab343192a8cde0b08db0dc56a3daae841f57741ea9b not found: ID does not exist"
Jul 06 16:40:49.644157 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.644122    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"]
Jul 06 16:40:49.650459 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:49.650422    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-2ltxz"]
Jul 06 16:40:50.645678 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:50.645643    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a972bd42-3c52-4233-b224-60e5fabe45bb" path="/var/lib/kubelet/pods/a972bd42-3c52-4233-b224-60e5fabe45bb/volumes"
Jul 06 16:40:52.915619 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.915572    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"]
Jul 06 16:40:52.916061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.915947    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" containerName="manager"
Jul 06 16:40:52.916061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.915959    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" containerName="manager"
Jul 06 16:40:52.916061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.915973    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a972bd42-3c52-4233-b224-60e5fabe45bb" containerName="manager"
Jul 06 16:40:52.916061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.915978    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a972bd42-3c52-4233-b224-60e5fabe45bb" containerName="manager"
Jul 06 16:40:52.916061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.916036    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a972bd42-3c52-4233-b224-60e5fabe45bb" containerName="manager"
Jul 06 16:40:52.916061 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.916044    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="579f06cb-d420-49f2-9730-eb3e3a9ae680" containerName="manager"
Jul 06 16:40:52.920496 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.920476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:52.922655 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.922626    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ltfzw\""
Jul 06 16:40:52.930248 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:52.930222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"]
Jul 06 16:40:53.076303 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks5ll\" (UniqueName: \"kubernetes.io/projected/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-kube-api-access-ks5ll\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.076707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.076644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177422 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177422 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177716 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks5ll\" (UniqueName: \"kubernetes.io/projected/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-kube-api-access-ks5ll\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177716 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177716 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177716 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177936 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177936 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.177936 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.177782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.178159 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.178079    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.178159 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.178107    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.178259 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.178204    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.178351 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.178329    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.178387 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.178346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.179711 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.179687    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.180334 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.180308    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.184966 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.184933    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.185073 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.184941    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks5ll\" (UniqueName: \"kubernetes.io/projected/7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c-kube-api-access-ks5ll\") pod \"maas-default-gateway-openshift-default-56654dcf7-kmg7k\" (UID: \"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.231853 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.231797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:53.371948 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.371913    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"]
Jul 06 16:40:53.375734 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:40:53.375707    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd9831b_a3f0_48a3_8d3b_8ce82dec1f3c.slice/crio-b9ac500fca9957e846a6b38043caaaae20f6400c339a1acc4982139341ea4cf3 WatchSource:0}: Error finding container b9ac500fca9957e846a6b38043caaaae20f6400c339a1acc4982139341ea4cf3: Status 404 returned error can't find the container with id b9ac500fca9957e846a6b38043caaaae20f6400c339a1acc4982139341ea4cf3
Jul 06 16:40:53.378180 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.378141    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:40:53.378251 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.378232    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:40:53.378318 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.378303    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:40:53.640128 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.640089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" event={"ID":"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c","Type":"ContainerStarted","Data":"1420471364bdc12c936c35acdbcac9eb58382f318d8620e189554f06c4d154fa"}
Jul 06 16:40:53.640351 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.640150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" event={"ID":"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c","Type":"ContainerStarted","Data":"b9ac500fca9957e846a6b38043caaaae20f6400c339a1acc4982139341ea4cf3"}
Jul 06 16:40:53.660346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:53.660287    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" podStartSLOduration=1.660265825 podStartE2EDuration="1.660265825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:53.659175142 +0000 UTC m=+763.526576371" watchObservedRunningTime="2026-07-06 16:40:53.660265825 +0000 UTC m=+763.527667053"
Jul 06 16:40:54.232372 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:54.232328    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:54.237394 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:54.237365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:54.646681 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:54.646646    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:54.646854 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:54.646742    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:40:56.226566 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.226529    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:40:56.657810 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.657774    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:40:56.658184 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.658159    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.660331 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.660310    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 16:40:56.664008 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.663981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:40:56.709305 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.709264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m65r\" (UniqueName: \"kubernetes.io/projected/15b30428-4c5a-4e9d-b012-1c93eb5301e3-kube-api-access-4m65r\") pod \"limitador-limitador-54d6d988d5-8zc86\" (UID: \"15b30428-4c5a-4e9d-b012-1c93eb5301e3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.709560 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.709540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/15b30428-4c5a-4e9d-b012-1c93eb5301e3-config-file\") pod \"limitador-limitador-54d6d988d5-8zc86\" (UID: \"15b30428-4c5a-4e9d-b012-1c93eb5301e3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.810848 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.810815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/15b30428-4c5a-4e9d-b012-1c93eb5301e3-config-file\") pod \"limitador-limitador-54d6d988d5-8zc86\" (UID: \"15b30428-4c5a-4e9d-b012-1c93eb5301e3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.811014 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.810880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m65r\" (UniqueName: \"kubernetes.io/projected/15b30428-4c5a-4e9d-b012-1c93eb5301e3-kube-api-access-4m65r\") pod \"limitador-limitador-54d6d988d5-8zc86\" (UID: \"15b30428-4c5a-4e9d-b012-1c93eb5301e3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.811469 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.811448    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/15b30428-4c5a-4e9d-b012-1c93eb5301e3-config-file\") pod \"limitador-limitador-54d6d988d5-8zc86\" (UID: \"15b30428-4c5a-4e9d-b012-1c93eb5301e3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.818587 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.818561    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m65r\" (UniqueName: \"kubernetes.io/projected/15b30428-4c5a-4e9d-b012-1c93eb5301e3-kube-api-access-4m65r\") pod \"limitador-limitador-54d6d988d5-8zc86\" (UID: \"15b30428-4c5a-4e9d-b012-1c93eb5301e3\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:56.969962 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:56.969872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:40:57.122713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:57.122686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:40:57.125037 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:40:57.125006    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b30428_4c5a_4e9d_b012_1c93eb5301e3.slice/crio-af119109df3dc4f57a3a85a3e383a8a63e50c7270d4c74d7e54d5d221c65c156 WatchSource:0}: Error finding container af119109df3dc4f57a3a85a3e383a8a63e50c7270d4c74d7e54d5d221c65c156: Status 404 returned error can't find the container with id af119109df3dc4f57a3a85a3e383a8a63e50c7270d4c74d7e54d5d221c65c156
Jul 06 16:40:57.663841 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:40:57.663803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86" event={"ID":"15b30428-4c5a-4e9d-b012-1c93eb5301e3","Type":"ContainerStarted","Data":"af119109df3dc4f57a3a85a3e383a8a63e50c7270d4c74d7e54d5d221c65c156"}
Jul 06 16:41:00.679857 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:41:00.679813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86" event={"ID":"15b30428-4c5a-4e9d-b012-1c93eb5301e3","Type":"ContainerStarted","Data":"d1419451764047275197da4a5b859a0d62c64823f8b28ce8f6ab485b84766a48"}
Jul 06 16:41:00.680251 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:41:00.679873    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:41:00.701993 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:41:00.701940    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86" podStartSLOduration=2.214837687 podStartE2EDuration="4.701925305s" totalImagesPullingTime="2.487087618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:41:00.699332789 +0000 UTC m=+770.566734016" watchObservedRunningTime="2026-07-06 16:41:00.701925305 +0000 UTC m=+770.569326546"
Jul 06 16:41:11.687707 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:41:11.687671    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8zc86"
Jul 06 16:42:12.498977 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:12.498938    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:42:20.055019 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:20.054934    2582 generic.go:356] "Generic (PLEG): container finished" podID="7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c" containerID="1420471364bdc12c936c35acdbcac9eb58382f318d8620e189554f06c4d154fa" exitCode=0
Jul 06 16:42:20.055019 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:20.055007    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" event={"ID":"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c","Type":"ContainerDied","Data":"1420471364bdc12c936c35acdbcac9eb58382f318d8620e189554f06c4d154fa"}
Jul 06 16:42:20.055480 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:20.055408    2582 scope.go:117] "RemoveContainer" containerID="1420471364bdc12c936c35acdbcac9eb58382f318d8620e189554f06c4d154fa"
Jul 06 16:42:20.056470 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:20.056436    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:42:20.056529 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:20.056511    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:42:20.056569 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:20.056550    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:42:21.061622 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:21.061570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" event={"ID":"7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c","Type":"ContainerStarted","Data":"644807b03fc77d5b2cac298623226bc9a74f2d1fbb3840c0873ff2add30f330b"}
Jul 06 16:42:21.232888 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:21.232853    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:42:21.234152 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:21.234122    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kmg7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 16:42:21.234377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:21.234343    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" podUID="7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 16:42:22.233109 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:22.233066    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kmg7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 16:42:22.233642 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:22.233152    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" podUID="7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 16:42:23.232777 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:23.232736    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kmg7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 16:42:23.233099 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:23.233066    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" podUID="7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 16:42:24.232271 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:24.232231    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-kmg7k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 06 16:42:24.232912 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:24.232873    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k" podUID="7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 06 16:42:24.649387 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:24.649353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:42:25.236207 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:25.236179    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:42:25.237346 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:25.237327    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-kmg7k"
Jul 06 16:42:31.895519 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:42:31.895480    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:43:03.007891 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:03.007810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:43:10.585941 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:10.585912    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:43:10.587139 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:10.587119    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:43:14.397923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:14.397882    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:43:27.696703 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:27.696666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:43:34.298326 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.298291    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"]
Jul 06 16:43:34.300998 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.300977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.303791 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.303764    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 16:43:34.303791 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.303780    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-692dm\""
Jul 06 16:43:34.304269 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.304248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 16:43:34.304389 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.304295    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 16:43:34.325679 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.325679 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325651    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"]
Jul 06 16:43:34.325919 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.325919 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkcgd\" (UniqueName: \"kubernetes.io/projected/726ef1f8-55af-4d8b-9c10-fa944111c2ea-kube-api-access-qkcgd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.325919 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.325919 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726ef1f8-55af-4d8b-9c10-fa944111c2ea-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.325919 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.325876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.426762 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.426729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkcgd\" (UniqueName: \"kubernetes.io/projected/726ef1f8-55af-4d8b-9c10-fa944111c2ea-kube-api-access-qkcgd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.426762 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.426767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.426993 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.426797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726ef1f8-55af-4d8b-9c10-fa944111c2ea-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.426993 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.426844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.426993 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.426891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.426993 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.426940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.427308 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.427283    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.427474 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.427348    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.427474 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.427361    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.429282 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.429246    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/726ef1f8-55af-4d8b-9c10-fa944111c2ea-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.429470 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.429451    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/726ef1f8-55af-4d8b-9c10-fa944111c2ea-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.441760 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.441736    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkcgd\" (UniqueName: \"kubernetes.io/projected/726ef1f8-55af-4d8b-9c10-fa944111c2ea-kube-api-access-qkcgd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-f6vhm\" (UID: \"726ef1f8-55af-4d8b-9c10-fa944111c2ea\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.611651 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.611531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:34.749358 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.748961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"]
Jul 06 16:43:34.752002 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:43:34.751974    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod726ef1f8_55af_4d8b_9c10_fa944111c2ea.slice/crio-30361249dfea1241c1dd90ec6f6f4f90bb9e8cd16d6e0c6155695eaccbcd8820 WatchSource:0}: Error finding container 30361249dfea1241c1dd90ec6f6f4f90bb9e8cd16d6e0c6155695eaccbcd8820: Status 404 returned error can't find the container with id 30361249dfea1241c1dd90ec6f6f4f90bb9e8cd16d6e0c6155695eaccbcd8820
Jul 06 16:43:34.753332 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:34.753311    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 16:43:35.415528 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:35.415487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm" event={"ID":"726ef1f8-55af-4d8b-9c10-fa944111c2ea","Type":"ContainerStarted","Data":"30361249dfea1241c1dd90ec6f6f4f90bb9e8cd16d6e0c6155695eaccbcd8820"}
Jul 06 16:43:36.422211 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:36.422172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm" event={"ID":"726ef1f8-55af-4d8b-9c10-fa944111c2ea","Type":"ContainerStarted","Data":"7c715ec7bccafbfdb686966eb4b562eedce59c022278f30c815cf2e549d0e42e"}
Jul 06 16:43:36.438565 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:36.438504    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm" podStartSLOduration=1.412040773 podStartE2EDuration="2.438484356s" totalImagesPullingTime="1.026443583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:43:36.438481759 +0000 UTC m=+926.305882988" watchObservedRunningTime="2026-07-06 16:43:36.438484356 +0000 UTC m=+926.305885562"
Jul 06 16:43:36.493017 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:36.492979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:43:44.611823 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:44.611780    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:44.612241 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:44.611856    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:44.624882 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:44.624845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:45.479996 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:45.479960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-f6vhm"
Jul 06 16:43:45.492130 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:43:45.492096    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:44:59.998754 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:44:59.998714    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:45:09.991207 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:45:09.991172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:45:20.593062 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:45:20.593026    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:45:30.497041 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:45:30.497002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:45:40.596532 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:45:40.596489    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:46:08.702226 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:46:08.702137    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:46:20.986394 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:46:20.986354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:46:55.586302 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:46:55.586260    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:47:04.688302 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:47:04.688259    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:47:12.898472 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:47:12.898426    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:47:22.791509 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:47:22.791458    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:47:32.500642 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:47:32.500533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:47:41.599143 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:47:41.599107    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:47:53.590719 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:47:53.590679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:48:02.796621 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:48:02.796569    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:48:10.615430 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:48:10.615403    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:48:10.617750 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:48:10.617722    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:48:25.695921 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:48:25.695883    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:48:34.192183 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:48:34.192145    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:48:58.590636 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:48:58.590580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:49:09.581938 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:49:09.581842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:49:24.891667 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:49:24.891628    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:49:34.590310 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:49:34.590274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:49:45.396306 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:49:45.396257    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:49:54.700146 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:49:54.700099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:50:03.399037 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:50:03.398991    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:51:53.493166 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:51:53.493126    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:52:04.297042 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:52:04.296943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:52:14.395727 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:52:14.395686    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:52:25.695776 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:52:25.695735    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:52:36.294521 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:52:36.294482    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:52:46.592363 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:52:46.592318    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:52:55.994451 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:52:55.994410    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:53:07.303125 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:53:07.303083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:53:10.652776 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:53:10.652746    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:53:10.655412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:53:10.655387    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:53:18.991213 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:53:18.991165    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:53:27.495261 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:53:27.495217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:53:37.809368 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:53:37.809283    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:54:02.299212 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:54:02.299172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:54:09.894558 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:54:09.894518    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:54:18.997175 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:54:18.997134    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:54:29.698848 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:54:29.698808    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:54:45.690233 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:54:45.690193    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:54:54.490481 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:54:54.490445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:55:03.800422 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:55:03.800325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:55:13.797295 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:55:13.797255    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:55:22.591962 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:55:22.591923    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:55:31.493853 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:55:31.493811    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:02.691074 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:02.691019    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:10.390626 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:10.390572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:18.895366 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:18.895327    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:28.092164 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:28.092125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:38.890528 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:38.890437    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:47.494668 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:47.494618    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:56:58.790114 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:56:58.790070    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:57:08.892447 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:57:08.892406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:57:21.693558 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:57:21.693521    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:57:33.688849 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:57:33.688804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:57:41.186499 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:57:41.186454    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:57:49.488409 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:57:49.488369    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:57:58.691616 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:57:58.691575    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:58:07.293169 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:07.293079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:58:10.681893 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:10.681865    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:58:10.686274 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:10.686251    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 16:58:16.393451 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.393409    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:58:16.894984 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.894943    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"]
Jul 06 16:58:16.898597 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.898568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.900894 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.900860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3566469b-openshift-default-dockercfg-9bbc2\""
Jul 06 16:58:16.927114 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.927079    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"]
Jul 06 16:58:16.964432 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-credential-socket\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964649 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4tc\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-kube-api-access-dj4tc\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964649 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6448c75c-55b1-49c2-861b-765139a79563-istio-podinfo\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964649 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-certs\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964649 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-istio-token\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964799 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-envoy\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964799 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-data\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964799 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6448c75c-55b1-49c2-861b-765139a79563-istiod-ca-cert\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:16.964893 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:16.964797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-socket\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.065632 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-istio-token\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.065833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-envoy\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.065833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-data\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.065833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6448c75c-55b1-49c2-861b-765139a79563-istiod-ca-cert\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.065833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-socket\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.065833 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-credential-socket\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066116 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4tc\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-kube-api-access-dj4tc\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066116 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6448c75c-55b1-49c2-861b-765139a79563-istio-podinfo\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066116 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.065958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-certs\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066290 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.066133    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-data\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066290 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.066200    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-credential-socket\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066290 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.066270    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-socket\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066398 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.066307    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-certs\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.066863 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.066837    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6448c75c-55b1-49c2-861b-765139a79563-istiod-ca-cert\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.068232 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.068207    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-envoy\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.068477 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.068457    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6448c75c-55b1-49c2-861b-765139a79563-istio-podinfo\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.076385 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.076354    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-istio-token\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.076975 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.076955    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4tc\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-kube-api-access-dj4tc\") pod \"e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") " pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.210017 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.209921    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:17.364377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.364230    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"]
Jul 06 16:58:17.367533 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:58:17.367498    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6448c75c_55b1_49c2_861b_765139a79563.slice/crio-d83bc497e803249bc7146ac3d6df37a0a4d972c5872d065b7eb88bd7bee938e3 WatchSource:0}: Error finding container d83bc497e803249bc7146ac3d6df37a0a4d972c5872d065b7eb88bd7bee938e3: Status 404 returned error can't find the container with id d83bc497e803249bc7146ac3d6df37a0a4d972c5872d065b7eb88bd7bee938e3
Jul 06 16:58:17.375132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.375074    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:17.375272 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.375237    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:17.375350 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.375325    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:17.687786 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.687746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg" event={"ID":"6448c75c-55b1-49c2-861b-765139a79563","Type":"ContainerStarted","Data":"86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab"}
Jul 06 16:58:17.688275 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.687831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg" event={"ID":"6448c75c-55b1-49c2-861b-765139a79563","Type":"ContainerStarted","Data":"d83bc497e803249bc7146ac3d6df37a0a4d972c5872d065b7eb88bd7bee938e3"}
Jul 06 16:58:17.707483 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:17.707425    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg" podStartSLOduration=1.707406541 podStartE2EDuration="1.707406541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:58:17.706362054 +0000 UTC m=+1807.573763284" watchObservedRunningTime="2026-07-06 16:58:17.707406541 +0000 UTC m=+1807.574807771"
Jul 06 16:58:18.211176 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:18.211132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:18.216203 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:18.216173    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:18.692904 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:18.692872    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:18.693890 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:18.693870    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:26.394640 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:26.394583    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"]
Jul 06 16:58:26.395112 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:26.394848    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg" podUID="6448c75c-55b1-49c2-861b-765139a79563" containerName="istio-proxy" containerID="cri-o://86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab" gracePeriod=30
Jul 06 16:58:27.001706 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:27.001667    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:58:29.455568 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.455540    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:29.589595 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589560    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-certs\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589595 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589598    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-istio-token\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-socket\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589677    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-credential-socket\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6448c75c-55b1-49c2-861b-765139a79563-istiod-ca-cert\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-envoy\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589768    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-data\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589813    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6448c75c-55b1-49c2-861b-765139a79563-istio-podinfo\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.589883 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589846    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj4tc\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-kube-api-access-dj4tc\") pod \"6448c75c-55b1-49c2-861b-765139a79563\" (UID: \"6448c75c-55b1-49c2-861b-765139a79563\") "
Jul 06 16:58:29.590248 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.589897    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:29.590248 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.590033    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:29.590248 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.590195    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.590248 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.590204    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:29.590248 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.590215    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.590730 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.590699    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6448c75c-55b1-49c2-861b-765139a79563-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:58:29.590868 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.590829    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-data" (OuterVolumeSpecName: "istio-data") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:29.592125 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.592097    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:29.592211 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.592107    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-istio-token" (OuterVolumeSpecName: "istio-token") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:58:29.592299 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.592282    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6448c75c-55b1-49c2-861b-765139a79563-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 16:58:29.592377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.592282    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-kube-api-access-dj4tc" (OuterVolumeSpecName: "kube-api-access-dj4tc") pod "6448c75c-55b1-49c2-861b-765139a79563" (UID: "6448c75c-55b1-49c2-861b-765139a79563"). InnerVolumeSpecName "kube-api-access-dj4tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:58:29.690722 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690683    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6448c75c-55b1-49c2-861b-765139a79563-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.690722 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690714    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.690722 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690722    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.690722 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690730    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6448c75c-55b1-49c2-861b-765139a79563-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.690722 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690738    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj4tc\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-kube-api-access-dj4tc\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.691060 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690747    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6448c75c-55b1-49c2-861b-765139a79563-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.691060 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.690755    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6448c75c-55b1-49c2-861b-765139a79563-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:29.746077 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.746043    2582 generic.go:356] "Generic (PLEG): container finished" podID="6448c75c-55b1-49c2-861b-765139a79563" containerID="86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab" exitCode=0
Jul 06 16:58:29.746297 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.746094    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"
Jul 06 16:58:29.746297 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.746117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg" event={"ID":"6448c75c-55b1-49c2-861b-765139a79563","Type":"ContainerDied","Data":"86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab"}
Jul 06 16:58:29.746297 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.746169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg" event={"ID":"6448c75c-55b1-49c2-861b-765139a79563","Type":"ContainerDied","Data":"d83bc497e803249bc7146ac3d6df37a0a4d972c5872d065b7eb88bd7bee938e3"}
Jul 06 16:58:29.746297 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.746182    2582 scope.go:117] "RemoveContainer" containerID="86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab"
Jul 06 16:58:29.756091 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.756068    2582 scope.go:117] "RemoveContainer" containerID="86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab"
Jul 06 16:58:29.756404 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:58:29.756386    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab\": container with ID starting with 86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab not found: ID does not exist" containerID="86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab"
Jul 06 16:58:29.756443 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.756416    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab"} err="failed to get container status \"86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab\": rpc error: code = NotFound desc = could not find container \"86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab\": container with ID starting with 86b2de3124e0285487b71141f1e148298e013541c0947340038ba699bcdb7fab not found: ID does not exist"
Jul 06 16:58:29.768026 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.767998    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"]
Jul 06 16:58:29.772771 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:29.772744    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3566469b-openshift-default-6597c9d9b5-fb4xg"]
Jul 06 16:58:30.647147 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:30.647112    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6448c75c-55b1-49c2-861b-765139a79563" path="/var/lib/kubelet/pods/6448c75c-55b1-49c2-861b-765139a79563/volumes"
Jul 06 16:58:32.613918 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.613874    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"]
Jul 06 16:58:32.614412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.614256    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6448c75c-55b1-49c2-861b-765139a79563" containerName="istio-proxy"
Jul 06 16:58:32.614412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.614267    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6448c75c-55b1-49c2-861b-765139a79563" containerName="istio-proxy"
Jul 06 16:58:32.614412 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.614325    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6448c75c-55b1-49c2-861b-765139a79563" containerName="istio-proxy"
Jul 06 16:58:32.619181 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.619151    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.621443 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.621407    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b2be3c64-openshift-default-dockercfg-s5trm\""
Jul 06 16:58:32.636720 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.636694    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"]
Jul 06 16:58:32.717720 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-credential-socket\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.717923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-envoy\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.717923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-data\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.717923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-certs\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.717923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-token\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.717923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istiod-ca-cert\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.718124 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-podinfo\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.718124 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.717982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-socket\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.718124 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.718078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qdd\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-kube-api-access-95qdd\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.818867 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.818825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-token\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.818867 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.818874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istiod-ca-cert\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.818918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-podinfo\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.818946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-socket\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.818989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95qdd\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-kube-api-access-95qdd\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-credential-socket\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-envoy\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819132 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-data\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819430 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-certs\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819430 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819396    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-socket\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819540 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819430    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-credential-socket\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819540 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-certs\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819698 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819548    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-data\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.819871 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.819850    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istiod-ca-cert\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.821332 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.821312    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-envoy\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.821703 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.821685    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-podinfo\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.826535 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.826510    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-token\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.826656 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.826596    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qdd\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-kube-api-access-95qdd\") pod \"e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") " pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:32.932183 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:32.932070    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:33.094736 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.094697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"]
Jul 06 16:58:33.098436 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:58:33.098405    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8aac3e8_025f_4bc0_bd5d_9ceba2795c40.slice/crio-e2ccd962f36cd2487eacab27f331d8d41e602939d0dcedba86951a451cdaa87e WatchSource:0}: Error finding container e2ccd962f36cd2487eacab27f331d8d41e602939d0dcedba86951a451cdaa87e: Status 404 returned error can't find the container with id e2ccd962f36cd2487eacab27f331d8d41e602939d0dcedba86951a451cdaa87e
Jul 06 16:58:33.102469 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.102427    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:33.102566 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.102533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:33.102637 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.102577    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:33.768303 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.768254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd" event={"ID":"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40","Type":"ContainerStarted","Data":"d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2"}
Jul 06 16:58:33.768718 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.768326    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd" event={"ID":"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40","Type":"ContainerStarted","Data":"e2ccd962f36cd2487eacab27f331d8d41e602939d0dcedba86951a451cdaa87e"}
Jul 06 16:58:33.789317 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.789242    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd" podStartSLOduration=1.7891832650000001 podStartE2EDuration="1.789183265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:58:33.788177448 +0000 UTC m=+1823.655578676" watchObservedRunningTime="2026-07-06 16:58:33.789183265 +0000 UTC m=+1823.656584495"
Jul 06 16:58:33.932313 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:33.932276    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:34.938669 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:34.938628    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:35.390592 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:35.390550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 16:58:35.782618 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:35.782582    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:35.783520 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:35.783502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:43.188744 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:43.188699    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"]
Jul 06 16:58:43.189193 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:43.188932    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd" podUID="d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" containerName="istio-proxy" containerID="cri-o://d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2" gracePeriod=30
Jul 06 16:58:49.248273 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.248240    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:49.376127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376029    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-credential-socket\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376073    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95qdd\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-kube-api-access-95qdd\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-socket\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376127 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376121    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-envoy\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376465 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376371    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-certs\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376465 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376421    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-data\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376465 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376420    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:49.376465 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376429    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:49.376465 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376456    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-podinfo\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376746 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376500    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-token\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376746 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376531    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istiod-ca-cert\") pod \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\" (UID: \"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40\") "
Jul 06 16:58:49.376746 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376641    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:49.376969 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376924    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:58:49.376969 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376948    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.377207 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376971    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.377207 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.376989    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.377350 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.377320    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:49.378460 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.378433    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:58:49.378701 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.378673    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-kube-api-access-95qdd" (OuterVolumeSpecName: "kube-api-access-95qdd") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "kube-api-access-95qdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:58:49.378701 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.378684    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:58:49.378835 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.378743    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" (UID: "d8aac3e8-025f-4bc0-bd5d-9ceba2795c40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 16:58:49.401988 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.401954    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"]
Jul 06 16:58:49.402421 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.402396    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" containerName="istio-proxy"
Jul 06 16:58:49.402421 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.402421    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" containerName="istio-proxy"
Jul 06 16:58:49.402788 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.402574    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" containerName="istio-proxy"
Jul 06 16:58:49.406165 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.406142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.408404 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.408380    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9cf2069a-openshift-default-dockercfg-n9kvd\""
Jul 06 16:58:49.421415 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.421385    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"]
Jul 06 16:58:49.478012 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.477972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-credential-socket\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478221 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-token\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478221 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-socket\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478221 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-podinfo\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478260    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-certs\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-envoy\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-data\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478411 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istiod-ca-cert\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrqx\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-kube-api-access-rvrqx\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478517    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478534    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478547    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478562    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478577    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95qdd\" (UniqueName: \"kubernetes.io/projected/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-kube-api-access-95qdd\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.478661 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.478591    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:58:49.579506 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-certs\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.579758 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-envoy\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.579758 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-data\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.579915 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istiod-ca-cert\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.579915 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrqx\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-kube-api-access-rvrqx\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.579915 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-credential-socket\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.579915 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-token\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-socket\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.579960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-podinfo\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.580052    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-certs\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.580075    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-data\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.580202    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-credential-socket\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580377 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.580309    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-socket\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.580728 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.580516    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istiod-ca-cert\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.582065 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.582038    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-envoy\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.582350 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.582334    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-podinfo\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.592366 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.592329    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-token\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.602059 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.602027    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrqx\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-kube-api-access-rvrqx\") pod \"e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") " pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.718923 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.718821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:49.854200 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.854166    2582 generic.go:356] "Generic (PLEG): container finished" podID="d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" containerID="d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2" exitCode=0
Jul 06 16:58:49.854385 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.854217    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"
Jul 06 16:58:49.854385 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.854244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd" event={"ID":"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40","Type":"ContainerDied","Data":"d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2"}
Jul 06 16:58:49.854385 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.854303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd" event={"ID":"d8aac3e8-025f-4bc0-bd5d-9ceba2795c40","Type":"ContainerDied","Data":"e2ccd962f36cd2487eacab27f331d8d41e602939d0dcedba86951a451cdaa87e"}
Jul 06 16:58:49.854385 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.854327    2582 scope.go:117] "RemoveContainer" containerID="d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2"
Jul 06 16:58:49.864401 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.864354    2582 scope.go:117] "RemoveContainer" containerID="d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2"
Jul 06 16:58:49.864888 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:58:49.864856    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2\": container with ID starting with d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2 not found: ID does not exist" containerID="d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2"
Jul 06 16:58:49.864993 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.864899    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2"} err="failed to get container status \"d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2\": rpc error: code = NotFound desc = could not find container \"d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2\": container with ID starting with d12c4aa9c21674dca7e921699c479173f88af3d1f01f30be6f49e882447ccaa2 not found: ID does not exist"
Jul 06 16:58:49.866171 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.866121    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"]
Jul 06 16:58:49.868423 ip-10-0-138-170 kubenswrapper[2582]: W0706 16:58:49.868395    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3fb8f52_dfeb_423b_ae4a_5b5d4a7e44f9.slice/crio-681a0d2b0e69122a7d759a6969bd93f34dabb3fdf524b504da721a013b531368 WatchSource:0}: Error finding container 681a0d2b0e69122a7d759a6969bd93f34dabb3fdf524b504da721a013b531368: Status 404 returned error can't find the container with id 681a0d2b0e69122a7d759a6969bd93f34dabb3fdf524b504da721a013b531368
Jul 06 16:58:49.870583 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.870551    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:49.870673 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.870638    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:49.870673 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.870668    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 16:58:49.876495 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.876474    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"]
Jul 06 16:58:49.879726 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:49.879701    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b2be3c64-openshift-default-8c6967869-v98fd"]
Jul 06 16:58:50.646431 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:50.646388    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8aac3e8-025f-4bc0-bd5d-9ceba2795c40" path="/var/lib/kubelet/pods/d8aac3e8-025f-4bc0-bd5d-9ceba2795c40/volumes"
Jul 06 16:58:50.864324 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:50.864287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg" event={"ID":"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9","Type":"ContainerStarted","Data":"67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d"}
Jul 06 16:58:50.864543 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:50.864355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg" event={"ID":"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9","Type":"ContainerStarted","Data":"681a0d2b0e69122a7d759a6969bd93f34dabb3fdf524b504da721a013b531368"}
Jul 06 16:58:50.889155 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:50.889101    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg" podStartSLOduration=1.8890827959999998 podStartE2EDuration="1.889082796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:58:50.886848431 +0000 UTC m=+1840.754249681" watchObservedRunningTime="2026-07-06 16:58:50.889082796 +0000 UTC m=+1840.756484088"
Jul 06 16:58:51.719791 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:51.719750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:51.724463 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:51.724434    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:51.869630 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:51.869564    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:51.870658 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:51.870637    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:58:58.294545 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:58.294508    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"]
Jul 06 16:58:58.299623 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:58:58.295258    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg" podUID="d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" containerName="istio-proxy" containerID="cri-o://67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d" gracePeriod=30
Jul 06 16:59:03.572207 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.572117    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:59:03.719051 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-podinfo\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719051 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-certs\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719082    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-token\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvrqx\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-kube-api-access-rvrqx\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-data\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719160    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-credential-socket\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-socket\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-envoy\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719307 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719274    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istiod-ca-cert\") pod \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\" (UID: \"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9\") "
Jul 06 16:59:03.719713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719375    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:59:03.719713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719514    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:59:03.719713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719532    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:59:03.719713 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719590    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:59:03.719920 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719751    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 16:59:03.719920 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719763    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.719920 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719786    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.719920 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719800    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.719920 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.719815    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.721725 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.721697    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:59:03.721855 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.721697    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 16:59:03.721922 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.721873    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 16:59:03.721922 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.721909    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-kube-api-access-rvrqx" (OuterVolumeSpecName: "kube-api-access-rvrqx") pod "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" (UID: "d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9"). InnerVolumeSpecName "kube-api-access-rvrqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 16:59:03.820719 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.820681    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.820719 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.820712    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.820719 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.820721    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.820719 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.820729    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.820990 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.820740    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvrqx\" (UniqueName: \"kubernetes.io/projected/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9-kube-api-access-rvrqx\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 16:59:03.931676 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.931548    2582 generic.go:356] "Generic (PLEG): container finished" podID="d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" containerID="67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d" exitCode=0
Jul 06 16:59:03.931676 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.931626    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"
Jul 06 16:59:03.931676 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.931646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg" event={"ID":"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9","Type":"ContainerDied","Data":"67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d"}
Jul 06 16:59:03.931976 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.931746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg" event={"ID":"d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9","Type":"ContainerDied","Data":"681a0d2b0e69122a7d759a6969bd93f34dabb3fdf524b504da721a013b531368"}
Jul 06 16:59:03.931976 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.931777    2582 scope.go:117] "RemoveContainer" containerID="67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d"
Jul 06 16:59:03.941721 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.941698    2582 scope.go:117] "RemoveContainer" containerID="67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d"
Jul 06 16:59:03.942031 ip-10-0-138-170 kubenswrapper[2582]: E0706 16:59:03.942010    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d\": container with ID starting with 67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d not found: ID does not exist" containerID="67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d"
Jul 06 16:59:03.942095 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.942042    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d"} err="failed to get container status \"67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d\": rpc error: code = NotFound desc = could not find container \"67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d\": container with ID starting with 67c0c9cf6ee0b9446b6ebca5fefd5ed3b6f051816ea983e6dc791b6ef99ba42d not found: ID does not exist"
Jul 06 16:59:03.953392 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.953350    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"]
Jul 06 16:59:03.959708 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:03.959678    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9cf2069a-openshift-default-c77f88cbc-5gqvg"]
Jul 06 16:59:04.646089 ip-10-0-138-170 kubenswrapper[2582]: I0706 16:59:04.646055    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" path="/var/lib/kubelet/pods/d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9/volumes"
Jul 06 17:00:28.094833 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:28.094789    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:00:36.591232 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:36.591192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:00:40.293482 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.293445    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"]
Jul 06 17:00:40.293906 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.293854    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" containerName="istio-proxy"
Jul 06 17:00:40.293906 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.293866    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" containerName="istio-proxy"
Jul 06 17:00:40.293992 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.293942    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3fb8f52-dfeb-423b-ae4a-5b5d4a7e44f9" containerName="istio-proxy"
Jul 06 17:00:40.297110 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.297091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.299319 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.299297    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9395f82e-openshift-default-dockercfg-6dg7s\""
Jul 06 17:00:40.308631 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.308585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"]
Jul 06 17:00:40.321146 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7s9z\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-kube-api-access-v7s9z\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321310 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-token\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321310 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-credential-socket\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321310 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321276    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-envoy\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321310 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-certs\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321544 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-podinfo\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321544 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istiod-ca-cert\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321544 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-socket\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.321544 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.321452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-data\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.421957 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.421918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-credential-socket\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.421975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-envoy\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-certs\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-podinfo\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istiod-ca-cert\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-socket\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-data\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422169 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7s9z\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-kube-api-access-v7s9z\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422517 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422192    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-token\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422563 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422540    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-credential-socket\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422630 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-certs\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.422861 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.422829    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-socket\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.423207 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.423185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-data\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.423867 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.423825    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istiod-ca-cert\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.424627 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.424590    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-envoy\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.425119 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.425103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-podinfo\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.430357 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.430323    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-token\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.430674 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.430653    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7s9z\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-kube-api-access-v7s9z\") pod \"e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") " pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.608187 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.608091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:40.749147 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.749004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"]
Jul 06 17:00:40.751496 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:00:40.751461    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d557e3b_feb6_4b2f_a3b2_2b0796f527af.slice/crio-8e71284946542518e34bb8dd9b52dc6723f2deb6493e029306b65c68c5033c8d WatchSource:0}: Error finding container 8e71284946542518e34bb8dd9b52dc6723f2deb6493e029306b65c68c5033c8d: Status 404 returned error can't find the container with id 8e71284946542518e34bb8dd9b52dc6723f2deb6493e029306b65c68c5033c8d
Jul 06 17:00:40.753784 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.753747    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:00:40.753878 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.753821    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:00:40.753878 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:40.753850    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:00:41.407216 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:41.407175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" event={"ID":"5d557e3b-feb6-4b2f-a3b2-2b0796f527af","Type":"ContainerStarted","Data":"cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"}
Jul 06 17:00:41.407651 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:41.407274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" event={"ID":"5d557e3b-feb6-4b2f-a3b2-2b0796f527af","Type":"ContainerStarted","Data":"8e71284946542518e34bb8dd9b52dc6723f2deb6493e029306b65c68c5033c8d"}
Jul 06 17:00:41.427387 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:41.427321    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podStartSLOduration=1.427300257 podStartE2EDuration="1.427300257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:00:41.426731849 +0000 UTC m=+1951.294133078" watchObservedRunningTime="2026-07-06 17:00:41.427300257 +0000 UTC m=+1951.294701497"
Jul 06 17:00:41.609015 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:41.608972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:41.614054 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:41.614020    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:42.412217 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:42.412190    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:42.413197 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:42.413178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:48.490486 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:48.490443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:00:56.489328 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:56.489296    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerID="cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c" exitCode=0
Jul 06 17:00:56.489745 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:56.489364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" event={"ID":"5d557e3b-feb6-4b2f-a3b2-2b0796f527af","Type":"ContainerDied","Data":"cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"}
Jul 06 17:00:56.489833 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:56.489818    2582 scope.go:117] "RemoveContainer" containerID="cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"
Jul 06 17:00:56.490940 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:56.490909    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:00:56.491018 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:56.490999    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:00:56.491054 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:56.491040    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:00:57.413070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:57.413029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:57.496343 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:57.496306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" event={"ID":"5d557e3b-feb6-4b2f-a3b2-2b0796f527af","Type":"ContainerStarted","Data":"6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4"}
Jul 06 17:00:57.609135 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:57.609098    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:00:57.610314 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:57.610286    2582 patch_prober.go:28] interesting pod/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 17:00:57.610445 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:57.610338    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 17:00:58.608832 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:58.608792    2582 patch_prober.go:28] interesting pod/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 17:00:58.609241 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:58.608848    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 17:00:59.099052 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:59.099015    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:00:59.609058 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:59.609011    2582 patch_prober.go:28] interesting pod/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 17:00:59.609487 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:00:59.609079    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 17:01:00.609487 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:00.609445    2582 patch_prober.go:28] interesting pod/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 17:01:00.609926 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:00.609523    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 17:01:01.609037 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:01.608999    2582 patch_prober.go:28] interesting pod/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 06 17:01:01.609231 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:01.609070    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 06 17:01:01.810919 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:01.810871    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"]
Jul 06 17:01:01.811477 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:01.811085    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy" containerID="cri-o://6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4" gracePeriod=30
Jul 06 17:01:07.176330 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.176301    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:01:07.287731 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287693    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-credential-socket\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.287731 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287738    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-socket\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287787    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-podinfo\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7s9z\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-kube-api-access-v7s9z\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287847    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istiod-ca-cert\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-certs\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287945    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-data\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.287982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-token\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-envoy\") pod \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\" (UID: \"5d557e3b-feb6-4b2f-a3b2-2b0796f527af\") "
Jul 06 17:01:07.288363 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288058    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:07.288363 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288297    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:07.288363 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288362    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.288591 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288380    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.288591 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288378    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:07.288729 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.288677    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:01:07.289105 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.289061    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:07.290355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.290326    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-kube-api-access-v7s9z" (OuterVolumeSpecName: "kube-api-access-v7s9z") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "kube-api-access-v7s9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:01:07.290501 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.290461    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:01:07.290753 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.290733    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:01:07.290833 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.290753    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d557e3b-feb6-4b2f-a3b2-2b0796f527af" (UID: "5d557e3b-feb6-4b2f-a3b2-2b0796f527af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:01:07.389113 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389071    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.389113 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389106    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7s9z\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-kube-api-access-v7s9z\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.389113 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389122    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.389361 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389134    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.389361 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389145    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.389361 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389156    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.389361 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.389167    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d557e3b-feb6-4b2f-a3b2-2b0796f527af-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:01:07.544364 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.544266    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerID="6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4" exitCode=0
Jul 06 17:01:07.544364 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.544316    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"
Jul 06 17:01:07.544556 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.544360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" event={"ID":"5d557e3b-feb6-4b2f-a3b2-2b0796f527af","Type":"ContainerDied","Data":"6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4"}
Jul 06 17:01:07.544556 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.544418    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx" event={"ID":"5d557e3b-feb6-4b2f-a3b2-2b0796f527af","Type":"ContainerDied","Data":"8e71284946542518e34bb8dd9b52dc6723f2deb6493e029306b65c68c5033c8d"}
Jul 06 17:01:07.544556 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.544443    2582 scope.go:117] "RemoveContainer" containerID="6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4"
Jul 06 17:01:07.554707 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.554688    2582 scope.go:117] "RemoveContainer" containerID="cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"
Jul 06 17:01:07.564800 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.564596    2582 scope.go:117] "RemoveContainer" containerID="6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4"
Jul 06 17:01:07.565075 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:01:07.565044    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4\": container with ID starting with 6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4 not found: ID does not exist" containerID="6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4"
Jul 06 17:01:07.565164 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.565090    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4"} err="failed to get container status \"6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4\": rpc error: code = NotFound desc = could not find container \"6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4\": container with ID starting with 6a9f8443979737030f0a2684c596191a8ffa5d683371415e6831e2c50510d1f4 not found: ID does not exist"
Jul 06 17:01:07.565164 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.565115    2582 scope.go:117] "RemoveContainer" containerID="cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"
Jul 06 17:01:07.565438 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:01:07.565416    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c\": container with ID starting with cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c not found: ID does not exist" containerID="cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"
Jul 06 17:01:07.565510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.565447    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c"} err="failed to get container status \"cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c\": rpc error: code = NotFound desc = could not find container \"cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c\": container with ID starting with cedbf63acea714677b59a6c540e2487811d4198de87670f5b618cfda525c210c not found: ID does not exist"
Jul 06 17:01:07.566771 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.566749    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"]
Jul 06 17:01:07.570231 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:07.570205    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9395f82e-openshift-default-7b5d44fc67-nmptx"]
Jul 06 17:01:08.646452 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:08.646414    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" path="/var/lib/kubelet/pods/5d557e3b-feb6-4b2f-a3b2-2b0796f527af/volumes"
Jul 06 17:01:22.296690 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.296658    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"]
Jul 06 17:01:22.297173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.297060    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy"
Jul 06 17:01:22.297173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.297072    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy"
Jul 06 17:01:22.297173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.297082    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy"
Jul 06 17:01:22.297173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.297088    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy"
Jul 06 17:01:22.297173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.297158    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy"
Jul 06 17:01:22.299153 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.299132    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.301420 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.301397    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a07fe89b-openshift-default-dockercfg-6q647\""
Jul 06 17:01:22.313208 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.313179    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"]
Jul 06 17:01:22.326100 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-data\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-envoy\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-credential-socket\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-socket\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-certs\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326484 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-istio-token\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326484 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a711d204-e506-4db6-98c7-c3f0845592a4-istiod-ca-cert\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326484 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a711d204-e506-4db6-98c7-c3f0845592a4-istio-podinfo\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.326640 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.326505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcj55\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-kube-api-access-pcj55\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.427673 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.427629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcj55\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-kube-api-access-pcj55\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.427840 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.427697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-data\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.427840 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.427721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-envoy\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.427840 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.427749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-credential-socket\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428013 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.427971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-socket\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428078 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-certs\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428132 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428087    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-istio-token\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428132 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428118    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-credential-socket\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428232 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a711d204-e506-4db6-98c7-c3f0845592a4-istiod-ca-cert\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428232 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a711d204-e506-4db6-98c7-c3f0845592a4-istio-podinfo\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428232 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428209    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-data\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428382 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428293    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-socket\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428382 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428332    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-certs\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.428865 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.428839    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a711d204-e506-4db6-98c7-c3f0845592a4-istiod-ca-cert\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.430621 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.430580    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-envoy\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.430778 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.430755    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a711d204-e506-4db6-98c7-c3f0845592a4-istio-podinfo\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.435495 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.435462    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcj55\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-kube-api-access-pcj55\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.436253 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.436233    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-istio-token\") pod \"e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") " pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.609887 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.609781    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:22.750972 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.750894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"]
Jul 06 17:01:22.753334 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:01:22.753301    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda711d204_e506_4db6_98c7_c3f0845592a4.slice/crio-978bdb318d004ac22af0c0113092ecd1b37e34d53c5b740f6158e49031f15c44 WatchSource:0}: Error finding container 978bdb318d004ac22af0c0113092ecd1b37e34d53c5b740f6158e49031f15c44: Status 404 returned error can't find the container with id 978bdb318d004ac22af0c0113092ecd1b37e34d53c5b740f6158e49031f15c44
Jul 06 17:01:22.755450 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.755418    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:01:22.755521 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.755485    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:01:22.755521 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:22.755518    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:01:23.621284 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:23.621250    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" event={"ID":"a711d204-e506-4db6-98c7-c3f0845592a4","Type":"ContainerStarted","Data":"7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"}
Jul 06 17:01:23.621764 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:23.621306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" event={"ID":"a711d204-e506-4db6-98c7-c3f0845592a4","Type":"ContainerStarted","Data":"978bdb318d004ac22af0c0113092ecd1b37e34d53c5b740f6158e49031f15c44"}
Jul 06 17:01:23.641042 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:23.640991    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podStartSLOduration=1.640974245 podStartE2EDuration="1.640974245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:01:23.639204192 +0000 UTC m=+1993.506605420" watchObservedRunningTime="2026-07-06 17:01:23.640974245 +0000 UTC m=+1993.508375549"
Jul 06 17:01:24.610010 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:24.609972    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:24.615102 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:24.615072    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:24.625877 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:24.625847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:24.626866 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:24.626847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:31.795216 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:31.795176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:01:39.628024 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.627988    2582 patch_prober.go:28] interesting pod/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 17:01:39.628451 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.628056    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 17:01:39.703216 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.703182    2582 generic.go:356] "Generic (PLEG): container finished" podID="a711d204-e506-4db6-98c7-c3f0845592a4" containerID="7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df" exitCode=0
Jul 06 17:01:39.703390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.703252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" event={"ID":"a711d204-e506-4db6-98c7-c3f0845592a4","Type":"ContainerDied","Data":"7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"}
Jul 06 17:01:39.703670 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.703656    2582 scope.go:117] "RemoveContainer" containerID="7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"
Jul 06 17:01:39.704727 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.704701    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:01:39.704795 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.704763    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:01:39.704831 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:39.704813    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:01:40.713037 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:40.712997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" event={"ID":"a711d204-e506-4db6-98c7-c3f0845592a4","Type":"ContainerStarted","Data":"8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6"}
Jul 06 17:01:41.610562 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:41.610503    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:41.610853 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:41.610824    2582 patch_prober.go:28] interesting pod/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 17:01:41.610928 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:41.610892    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 17:01:42.610890 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:42.610847    2582 patch_prober.go:28] interesting pod/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 17:01:42.611347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:42.610912    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 17:01:43.610688 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:43.610648    2582 patch_prober.go:28] interesting pod/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 06 17:01:43.610884 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:43.610709    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 06 17:01:44.616065 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:44.616030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:44.616549 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:44.616312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:44.617259 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:44.617240    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:01:48.093784 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.093742    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"]
Jul 06 17:01:48.094284 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.094269    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d557e3b-feb6-4b2f-a3b2-2b0796f527af" containerName="istio-proxy"
Jul 06 17:01:48.097554 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.097516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.099598 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.099574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a07fe89b\"/\"kube-root-ca.crt\""
Jul 06 17:01:48.099760 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.099713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a07fe89b\"/\"default-dockercfg-pm88d\""
Jul 06 17:01:48.100272 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.100253    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a07fe89b\"/\"openshift-service-ca.crt\""
Jul 06 17:01:48.100372 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.100277    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a07fe89b\"/\"e2e-lifecycle-model-a07fe89b-kserve-self-signed-certs\""
Jul 06 17:01:48.104968 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.104933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"]
Jul 06 17:01:48.183428 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.183376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-tmp-dir\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.183652 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.183454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-home\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.183652 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.183535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-dshm\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.183652 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.183553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264e21a8-44b8-4267-8b13-ace73e19cc5e-tls-certs\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.183652 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.183582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-model-cache\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.183652 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.183630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tdgq\" (UniqueName: \"kubernetes.io/projected/264e21a8-44b8-4267-8b13-ace73e19cc5e-kube-api-access-6tdgq\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285151 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-dshm\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285359 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264e21a8-44b8-4267-8b13-ace73e19cc5e-tls-certs\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285359 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-model-cache\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285359 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tdgq\" (UniqueName: \"kubernetes.io/projected/264e21a8-44b8-4267-8b13-ace73e19cc5e-kube-api-access-6tdgq\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285359 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-tmp-dir\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285359 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-home\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.285875 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.285832    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-home\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.286116 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.286094    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-tmp-dir\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.286531 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.286501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-model-cache\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.288150 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.287991    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-dshm\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.289021 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.288996    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264e21a8-44b8-4267-8b13-ace73e19cc5e-tls-certs\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.294481 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.294437    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tdgq\" (UniqueName: \"kubernetes.io/projected/264e21a8-44b8-4267-8b13-ace73e19cc5e-kube-api-access-6tdgq\") pod \"e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") " pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.408367 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.408256    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:48.550039 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.550008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"]
Jul 06 17:01:48.552049 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:01:48.552019    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod264e21a8_44b8_4267_8b13_ace73e19cc5e.slice/crio-6448787000ba4bbd3b3354a2dd8267d79e9e7e22d14cc56237d409b11ce02866 WatchSource:0}: Error finding container 6448787000ba4bbd3b3354a2dd8267d79e9e7e22d14cc56237d409b11ce02866: Status 404 returned error can't find the container with id 6448787000ba4bbd3b3354a2dd8267d79e9e7e22d14cc56237d409b11ce02866
Jul 06 17:01:48.754170 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.754139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm" event={"ID":"264e21a8-44b8-4267-8b13-ace73e19cc5e","Type":"ContainerStarted","Data":"5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea"}
Jul 06 17:01:48.754352 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:48.754182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm" event={"ID":"264e21a8-44b8-4267-8b13-ace73e19cc5e","Type":"ContainerStarted","Data":"6448787000ba4bbd3b3354a2dd8267d79e9e7e22d14cc56237d409b11ce02866"}
Jul 06 17:01:51.589047 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:51.588988    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm" podStartSLOduration=3.588970315 podStartE2EDuration="3.588970315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:01:48.768667341 +0000 UTC m=+2018.636068560" watchObservedRunningTime="2026-07-06 17:01:51.588970315 +0000 UTC m=+2021.456371543"
Jul 06 17:01:51.589568 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:51.589552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:01:58.409232 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:58.409182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:58.409680 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:58.409247    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:58.422138 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:58.422105    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:01:58.816029 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:01:58.815991    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:02:07.192712 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:07.192674    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:02:16.196906 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:16.196867    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:02:24.163394 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:24.163355    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"]
Jul 06 17:02:28.307256 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:28.307220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:02:39.184802 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.184703    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm" podUID="264e21a8-44b8-4267-8b13-ace73e19cc5e" containerName="main" containerID="cri-o://5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea" gracePeriod=45
Jul 06 17:02:39.444588 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.444517    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:02:39.565193 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565155    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264e21a8-44b8-4267-8b13-ace73e19cc5e-tls-certs\") pod \"264e21a8-44b8-4267-8b13-ace73e19cc5e\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") "
Jul 06 17:02:39.565368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565209    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-model-cache\") pod \"264e21a8-44b8-4267-8b13-ace73e19cc5e\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") "
Jul 06 17:02:39.565368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-dshm\") pod \"264e21a8-44b8-4267-8b13-ace73e19cc5e\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") "
Jul 06 17:02:39.565368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565323    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tdgq\" (UniqueName: \"kubernetes.io/projected/264e21a8-44b8-4267-8b13-ace73e19cc5e-kube-api-access-6tdgq\") pod \"264e21a8-44b8-4267-8b13-ace73e19cc5e\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") "
Jul 06 17:02:39.565489 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565388    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-tmp-dir\") pod \"264e21a8-44b8-4267-8b13-ace73e19cc5e\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") "
Jul 06 17:02:39.565489 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565416    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-home\") pod \"264e21a8-44b8-4267-8b13-ace73e19cc5e\" (UID: \"264e21a8-44b8-4267-8b13-ace73e19cc5e\") "
Jul 06 17:02:39.565574 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565532    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-model-cache" (OuterVolumeSpecName: "model-cache") pod "264e21a8-44b8-4267-8b13-ace73e19cc5e" (UID: "264e21a8-44b8-4267-8b13-ace73e19cc5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:02:39.565764 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565715    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "264e21a8-44b8-4267-8b13-ace73e19cc5e" (UID: "264e21a8-44b8-4267-8b13-ace73e19cc5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:02:39.565851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565768    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-home" (OuterVolumeSpecName: "home") pod "264e21a8-44b8-4267-8b13-ace73e19cc5e" (UID: "264e21a8-44b8-4267-8b13-ace73e19cc5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:02:39.565851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.565807    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-model-cache\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:02:39.567888 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.567857    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264e21a8-44b8-4267-8b13-ace73e19cc5e-kube-api-access-6tdgq" (OuterVolumeSpecName: "kube-api-access-6tdgq") pod "264e21a8-44b8-4267-8b13-ace73e19cc5e" (UID: "264e21a8-44b8-4267-8b13-ace73e19cc5e"). InnerVolumeSpecName "kube-api-access-6tdgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:02:39.567888 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.567874    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/264e21a8-44b8-4267-8b13-ace73e19cc5e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "264e21a8-44b8-4267-8b13-ace73e19cc5e" (UID: "264e21a8-44b8-4267-8b13-ace73e19cc5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:02:39.568487 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.568453    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-dshm" (OuterVolumeSpecName: "dshm") pod "264e21a8-44b8-4267-8b13-ace73e19cc5e" (UID: "264e21a8-44b8-4267-8b13-ace73e19cc5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:02:39.667057 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.667019    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264e21a8-44b8-4267-8b13-ace73e19cc5e-tls-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:02:39.667057 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.667052    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-dshm\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:02:39.667057 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.667061    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tdgq\" (UniqueName: \"kubernetes.io/projected/264e21a8-44b8-4267-8b13-ace73e19cc5e-kube-api-access-6tdgq\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:02:39.667309 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.667072    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-tmp-dir\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:02:39.667309 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:39.667082    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264e21a8-44b8-4267-8b13-ace73e19cc5e-home\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:02:40.013078 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.013043    2582 generic.go:356] "Generic (PLEG): container finished" podID="264e21a8-44b8-4267-8b13-ace73e19cc5e" containerID="5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea" exitCode=0
Jul 06 17:02:40.013254 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.013090    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"
Jul 06 17:02:40.013254 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.013127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm" event={"ID":"264e21a8-44b8-4267-8b13-ace73e19cc5e","Type":"ContainerDied","Data":"5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea"}
Jul 06 17:02:40.013254 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.013172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm" event={"ID":"264e21a8-44b8-4267-8b13-ace73e19cc5e","Type":"ContainerDied","Data":"6448787000ba4bbd3b3354a2dd8267d79e9e7e22d14cc56237d409b11ce02866"}
Jul 06 17:02:40.013254 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.013194    2582 scope.go:117] "RemoveContainer" containerID="5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea"
Jul 06 17:02:40.022634 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.022591    2582 scope.go:117] "RemoveContainer" containerID="5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea"
Jul 06 17:02:40.022938 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:02:40.022917    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea\": container with ID starting with 5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea not found: ID does not exist" containerID="5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea"
Jul 06 17:02:40.022998 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.022949    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea"} err="failed to get container status \"5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea\": rpc error: code = NotFound desc = could not find container \"5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea\": container with ID starting with 5a18934837d67c3d1e09186ab883ac89c27319be66661649d2cb490db76b33ea not found: ID does not exist"
Jul 06 17:02:40.032484 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.032457    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"]
Jul 06 17:02:40.038861 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.038835    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a07fe89b/e2e-lifecycle-model-a07fe89b-kserve-6b855b45c9-zvncm"]
Jul 06 17:02:40.645401 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:02:40.645357    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264e21a8-44b8-4267-8b13-ace73e19cc5e" path="/var/lib/kubelet/pods/264e21a8-44b8-4267-8b13-ace73e19cc5e/volumes"
Jul 06 17:03:01.187316 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:01.187277    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:03:10.712276 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:10.712244    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:03:10.724971 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:10.724934    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:03:26.444831 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:26.444795    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"]
Jul 06 17:03:26.445232 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:26.445092    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy" containerID="cri-o://8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6" gracePeriod=30
Jul 06 17:03:29.619452 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:29.619410    2582 patch_prober.go:28] interesting pod/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 17:03:29.619884 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:29.619485    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 17:03:30.301080 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:30.301045    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:03:31.708010 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.707940    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:03:31.744198 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744164    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-envoy\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744385 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744251    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-data\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744385 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744315    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-socket\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744385 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-credential-socket\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744385 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744352    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a711d204-e506-4db6-98c7-c3f0845592a4-istiod-ca-cert\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744385 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcj55\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-kube-api-access-pcj55\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744684 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744405    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-certs\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744684 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-istio-token\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744684 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a711d204-e506-4db6-98c7-c3f0845592a4-istio-podinfo\") pod \"a711d204-e506-4db6-98c7-c3f0845592a4\" (UID: \"a711d204-e506-4db6-98c7-c3f0845592a4\") "
Jul 06 17:03:31.744835 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744730    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:31.745209 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744947    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.745209 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.744978    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:31.745209 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.745036    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:31.745429 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.745222    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:31.745429 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.745332    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a711d204-e506-4db6-98c7-c3f0845592a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:03:31.747064 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.747033    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:03:31.747300 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.747249    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-kube-api-access-pcj55" (OuterVolumeSpecName: "kube-api-access-pcj55") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "kube-api-access-pcj55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:03:31.747565 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.747544    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:03:31.747647 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.747583    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a711d204-e506-4db6-98c7-c3f0845592a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a711d204-e506-4db6-98c7-c3f0845592a4" (UID: "a711d204-e506-4db6-98c7-c3f0845592a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:03:31.846431 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846389    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846431 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846425    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a711d204-e506-4db6-98c7-c3f0845592a4-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846431 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846436    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcj55\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-kube-api-access-pcj55\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846811 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846455    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846811 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846463    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a711d204-e506-4db6-98c7-c3f0845592a4-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846811 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846471    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a711d204-e506-4db6-98c7-c3f0845592a4-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846811 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846478    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:31.846811 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:31.846487    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a711d204-e506-4db6-98c7-c3f0845592a4-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:03:32.267356 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.267321    2582 generic.go:356] "Generic (PLEG): container finished" podID="a711d204-e506-4db6-98c7-c3f0845592a4" containerID="8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6" exitCode=0
Jul 06 17:03:32.267543 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.267376    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"
Jul 06 17:03:32.267543 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.267408    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" event={"ID":"a711d204-e506-4db6-98c7-c3f0845592a4","Type":"ContainerDied","Data":"8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6"}
Jul 06 17:03:32.267543 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.267465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq" event={"ID":"a711d204-e506-4db6-98c7-c3f0845592a4","Type":"ContainerDied","Data":"978bdb318d004ac22af0c0113092ecd1b37e34d53c5b740f6158e49031f15c44"}
Jul 06 17:03:32.267543 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.267490    2582 scope.go:117] "RemoveContainer" containerID="8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6"
Jul 06 17:03:32.279908 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.279884    2582 scope.go:117] "RemoveContainer" containerID="7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"
Jul 06 17:03:32.288681 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.288660    2582 scope.go:117] "RemoveContainer" containerID="8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6"
Jul 06 17:03:32.289022 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:03:32.289001    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6\": container with ID starting with 8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6 not found: ID does not exist" containerID="8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6"
Jul 06 17:03:32.289075 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.289031    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6"} err="failed to get container status \"8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6\": rpc error: code = NotFound desc = could not find container \"8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6\": container with ID starting with 8366e9068fc7ed020e36e10c4fad88c9f9f2f144903985933b7e4bad250655e6 not found: ID does not exist"
Jul 06 17:03:32.289075 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.289054    2582 scope.go:117] "RemoveContainer" containerID="7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"
Jul 06 17:03:32.289163 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.289053    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"]
Jul 06 17:03:32.289336 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:03:32.289317    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df\": container with ID starting with 7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df not found: ID does not exist" containerID="7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"
Jul 06 17:03:32.289388 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.289344    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df"} err="failed to get container status \"7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df\": rpc error: code = NotFound desc = could not find container \"7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df\": container with ID starting with 7ad2c3eb413a707620d354b7f94d2127063896b2d951a5a7c120557a40c283df not found: ID does not exist"
Jul 06 17:03:32.294733 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.294706    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a07fe89b-openshift-default-5cb9dfb599-n9jjq"]
Jul 06 17:03:32.645567 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:32.645483    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" path="/var/lib/kubelet/pods/a711d204-e506-4db6-98c7-c3f0845592a4/volumes"
Jul 06 17:03:43.594299 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:03:43.594264    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:04:21.096879 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.096792    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"]
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097172    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097184    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097191    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264e21a8-44b8-4267-8b13-ace73e19cc5e" containerName="main"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097196    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="264e21a8-44b8-4267-8b13-ace73e19cc5e" containerName="main"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097209    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097215    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097269    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097280    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a711d204-e506-4db6-98c7-c3f0845592a4" containerName="istio-proxy"
Jul 06 17:04:21.097360 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.097286    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="264e21a8-44b8-4267-8b13-ace73e19cc5e" containerName="main"
Jul 06 17:04:21.100236 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.100219    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.102222 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.102195    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c7ba28-openshift-default-dockercfg-6lfn9\""
Jul 06 17:04:21.112135 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.112106    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"]
Jul 06 17:04:21.191765 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.191725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istiod-ca-cert\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192091 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-token\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192198 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-socket\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192198 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-envoy\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192198 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-podinfo\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192383 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-data\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192444 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhpcw\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-kube-api-access-rhpcw\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192493 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-credential-socket\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.192551 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.192526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-certs\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294035 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.293977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istiod-ca-cert\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294035 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-token\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294308 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-socket\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294308 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-envoy\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294308 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-podinfo\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294469 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294419    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-data\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294469 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhpcw\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-kube-api-access-rhpcw\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294583 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-credential-socket\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294583 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294549    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-certs\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294718 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294593    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-socket\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.294927 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294900    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-data\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.295068 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.294941    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istiod-ca-cert\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.295154 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.295138    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-certs\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.295221 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.295191    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-credential-socket\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.296636 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.296598    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-envoy\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.296856 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.296837    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-podinfo\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.302787 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.302761    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-token\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.302897 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.302851    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhpcw\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-kube-api-access-rhpcw\") pod \"e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") " pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.412324 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.412225    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:21.558234 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.558206    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"]
Jul 06 17:04:21.560393 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:04:21.560359    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9921c205_ffa6_4735_9a94_3b24f39b2f9b.slice/crio-1a95eb2377a8b196f764f9aefab4af6c09781f9b151c756c564482120351d837 WatchSource:0}: Error finding container 1a95eb2377a8b196f764f9aefab4af6c09781f9b151c756c564482120351d837: Status 404 returned error can't find the container with id 1a95eb2377a8b196f764f9aefab4af6c09781f9b151c756c564482120351d837
Jul 06 17:04:21.562673 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.562592    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:21.562764 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.562709    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:21.562764 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:21.562739    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:22.512286 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:22.512255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" event={"ID":"9921c205-ffa6-4735-9a94-3b24f39b2f9b","Type":"ContainerStarted","Data":"3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"}
Jul 06 17:04:22.512720 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:22.512317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" event={"ID":"9921c205-ffa6-4735-9a94-3b24f39b2f9b","Type":"ContainerStarted","Data":"1a95eb2377a8b196f764f9aefab4af6c09781f9b151c756c564482120351d837"}
Jul 06 17:04:22.530573 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:22.530512    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podStartSLOduration=1.530488626 podStartE2EDuration="1.530488626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:04:22.529304026 +0000 UTC m=+2172.396705274" watchObservedRunningTime="2026-07-06 17:04:22.530488626 +0000 UTC m=+2172.397889856"
Jul 06 17:04:23.413441 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:23.413397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:23.418421 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:23.418396    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:23.517434 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:23.517398    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:23.518495 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:23.518477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:29.694930 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.694894    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"]
Jul 06 17:04:29.699530 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.699502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.702173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.702149    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-56aa0f-openshift-default-dockercfg-l449b\""
Jul 06 17:04:29.711375 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.711350    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"]
Jul 06 17:04:29.775892 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.775845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-socket\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776071 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.775916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-data\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776071 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.775944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl79z\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-kube-api-access-jl79z\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776071 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.775979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76690d66-51c5-4279-9674-6c257a67d598-istiod-ca-cert\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776071 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.776012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76690d66-51c5-4279-9674-6c257a67d598-istio-podinfo\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776212 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.776075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-credential-socket\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776212 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.776106    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-istio-token\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776212 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.776136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-certs\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.776212 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.776202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-envoy\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877309 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-envoy\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-socket\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-data\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl79z\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-kube-api-access-jl79z\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76690d66-51c5-4279-9674-6c257a67d598-istiod-ca-cert\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76690d66-51c5-4279-9674-6c257a67d598-istio-podinfo\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-credential-socket\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877510 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877489    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-istio-token\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877925 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-certs\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.877925 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877899    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-data\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.878045 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.877950    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-socket\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.878177 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.878152    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-credential-socket\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.878248 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.878190    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-certs\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.878364 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.878336    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76690d66-51c5-4279-9674-6c257a67d598-istiod-ca-cert\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.879852 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.879831    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-envoy\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.880240 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.880218    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76690d66-51c5-4279-9674-6c257a67d598-istio-podinfo\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.885254 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.885229    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-istio-token\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:29.885473 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:29.885451    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl79z\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-kube-api-access-jl79z\") pod \"e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") " pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:30.012489 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.012445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:30.164706 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.164670    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"]
Jul 06 17:04:30.168223 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:04:30.168190    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76690d66_51c5_4279_9674_6c257a67d598.slice/crio-e3cf148ffd10ef0621a1611633e1d9c4d995408c14ee4106d751dbbba647c47d WatchSource:0}: Error finding container e3cf148ffd10ef0621a1611633e1d9c4d995408c14ee4106d751dbbba647c47d: Status 404 returned error can't find the container with id e3cf148ffd10ef0621a1611633e1d9c4d995408c14ee4106d751dbbba647c47d
Jul 06 17:04:30.170493 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.170460    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:30.170563 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.170528    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:30.170563 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.170558    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:30.301832 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.294433    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:04:30.556173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.556061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" event={"ID":"76690d66-51c5-4279-9674-6c257a67d598","Type":"ContainerStarted","Data":"c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"}
Jul 06 17:04:30.556173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.556134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" event={"ID":"76690d66-51c5-4279-9674-6c257a67d598","Type":"ContainerStarted","Data":"e3cf148ffd10ef0621a1611633e1d9c4d995408c14ee4106d751dbbba647c47d"}
Jul 06 17:04:30.580798 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:30.580748    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" podStartSLOduration=1.5807298319999998 podStartE2EDuration="1.580729832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:04:30.579236349 +0000 UTC m=+2180.446637577" watchObservedRunningTime="2026-07-06 17:04:30.580729832 +0000 UTC m=+2180.448131059"
Jul 06 17:04:31.013516 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:31.013480    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:31.018483 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:31.018456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:31.561891 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:31.561853    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:31.562839 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:31.562816    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:38.519598 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.519570    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 17:04:38.519993 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.519650    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 17:04:38.599038 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.599004    2582 generic.go:356] "Generic (PLEG): container finished" podID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerID="3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7" exitCode=0
Jul 06 17:04:38.599212 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.599051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" event={"ID":"9921c205-ffa6-4735-9a94-3b24f39b2f9b","Type":"ContainerDied","Data":"3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"}
Jul 06 17:04:38.599468 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.599453    2582 scope.go:117] "RemoveContainer" containerID="3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"
Jul 06 17:04:38.600572 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.600537    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:38.600717 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.600658    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:38.600789 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:38.600713    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:39.605560 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:39.605520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" event={"ID":"9921c205-ffa6-4735-9a94-3b24f39b2f9b","Type":"ContainerStarted","Data":"f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c"}
Jul 06 17:04:40.412379 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:40.412340    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:40.412594 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:40.412571    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 17:04:40.412683 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:40.412646    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 17:04:41.413716 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:41.413590    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 17:04:41.413716 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:41.413690    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 17:04:42.413402 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:42.413365    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 17:04:42.413643 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:42.413427    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 17:04:42.898588 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:42.898546    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:04:43.413787 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:43.413751    2582 patch_prober.go:28] interesting pod/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 06 17:04:43.413987 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:43.413809    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 06 17:04:44.462735 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:44.462698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:44.463260 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:44.463243    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:44.465588 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:44.465563    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:04:45.639568 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:45.639534    2582 generic.go:356] "Generic (PLEG): container finished" podID="76690d66-51c5-4279-9674-6c257a67d598" containerID="c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad" exitCode=0
Jul 06 17:04:45.640064 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:45.639630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" event={"ID":"76690d66-51c5-4279-9674-6c257a67d598","Type":"ContainerDied","Data":"c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"}
Jul 06 17:04:45.640117 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:45.640096    2582 scope.go:117] "RemoveContainer" containerID="c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"
Jul 06 17:04:45.641086 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:45.641055    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:45.641152 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:45.641123    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:45.641189 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:45.641157    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:04:46.562126 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:46.562083    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:46.669411 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:46.669374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" event={"ID":"76690d66-51c5-4279-9674-6c257a67d598","Type":"ContainerStarted","Data":"f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f"}
Jul 06 17:04:47.013437 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:47.013391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:47.014424 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:47.014399    2582 patch_prober.go:28] interesting pod/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 17:04:47.014555 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:47.014463    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 17:04:48.012954 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:48.012907    2582 patch_prober.go:28] interesting pod/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 17:04:48.013381 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:48.012970    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 17:04:49.013507 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:49.013465    2582 patch_prober.go:28] interesting pod/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 17:04:49.013950 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:49.013522    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 17:04:50.013501 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:50.013457    2582 patch_prober.go:28] interesting pod/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 06 17:04:50.013718 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:50.013533    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 06 17:04:51.016891 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:51.016858    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:51.017292 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:51.017166    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:51.017902 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:51.017883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:04:53.194161 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:04:53.194119    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:05:12.791181 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:05:12.791141    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:06:30.486177 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:30.486143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:06:41.880995 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.880958    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"]
Jul 06 17:06:41.884153 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.884133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:41.886841 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.886821    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-6ae947\"/\"default-dockercfg-p955p\""
Jul 06 17:06:41.886841 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.886823    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-6ae947\"/\"kube-root-ca.crt\""
Jul 06 17:06:41.887018 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.886861    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-6ae947\"/\"openshift-service-ca.crt\""
Jul 06 17:06:41.887018 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.886863    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-6ae947\"/\"test-model-6ae947-kserve-self-signed-certs\""
Jul 06 17:06:41.894106 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.894080    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"]
Jul 06 17:06:41.958321 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.958281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-home\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:41.958519 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.958355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tmp-dir\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:41.958519 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.958378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tls-certs\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:41.958519 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.958403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-model-cache\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:41.958519 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.958447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khrqh\" (UniqueName: \"kubernetes.io/projected/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-kube-api-access-khrqh\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:41.958519 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:41.958496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-dshm\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060037 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.059998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-home\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060238 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tmp-dir\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060238 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tls-certs\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060238 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-model-cache\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060238 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khrqh\" (UniqueName: \"kubernetes.io/projected/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-kube-api-access-khrqh\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060238 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-dshm\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060516 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060488    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-home\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060573 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060534    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tmp-dir\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.060573 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.060555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-model-cache\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.062520 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.062503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-dshm\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.062829 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.062812    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tls-certs\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.067463 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.067438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khrqh\" (UniqueName: \"kubernetes.io/projected/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-kube-api-access-khrqh\") pod \"test-model-6ae947-kserve-6b5f874cfc-wcxgv\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") " pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.194637 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.194527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:42.337460 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:42.337433    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"]
Jul 06 17:06:42.339918 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:06:42.339890    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podccf7d387_214d_4cc6_bfb1_5f12c862b8e2.slice/crio-a0283ba186173bb1dd60310115dae895b736202b997840148c22d67dbfc8cb1d WatchSource:0}: Error finding container a0283ba186173bb1dd60310115dae895b736202b997840148c22d67dbfc8cb1d: Status 404 returned error can't find the container with id a0283ba186173bb1dd60310115dae895b736202b997840148c22d67dbfc8cb1d
Jul 06 17:06:43.267322 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:43.267282    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv" event={"ID":"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2","Type":"ContainerStarted","Data":"83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733"}
Jul 06 17:06:43.267322 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:43.267330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv" event={"ID":"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2","Type":"ContainerStarted","Data":"a0283ba186173bb1dd60310115dae895b736202b997840148c22d67dbfc8cb1d"}
Jul 06 17:06:43.283531 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:43.283473    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv" podStartSLOduration=2.283456444 podStartE2EDuration="2.283456444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:06:43.282391461 +0000 UTC m=+2313.149792728" watchObservedRunningTime="2026-07-06 17:06:43.283456444 +0000 UTC m=+2313.150857673"
Jul 06 17:06:48.496131 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:48.496097    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:06:52.195138 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:52.195099    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:52.195669 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:52.195400    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:52.207833 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:52.207805    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:06:52.323180 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:06:52.323139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:07:09.459497 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:09.459418    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"]
Jul 06 17:07:12.586094 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:12.586054    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:07:24.480250 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.480199    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv" podUID="ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" containerName="main" containerID="cri-o://83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733" gracePeriod=45
Jul 06 17:07:24.748214 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.748179    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:07:24.892807 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.892762    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-dshm\") pod \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") "
Jul 06 17:07:24.892807 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.892812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tmp-dir\") pod \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") "
Jul 06 17:07:24.893084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.892863    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-model-cache\") pod \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") "
Jul 06 17:07:24.893084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.892912    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-home\") pod \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") "
Jul 06 17:07:24.893084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.892941    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tls-certs\") pod \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") "
Jul 06 17:07:24.893084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khrqh\" (UniqueName: \"kubernetes.io/projected/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-kube-api-access-khrqh\") pod \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\" (UID: \"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2\") "
Jul 06 17:07:24.893294 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893157    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-model-cache" (OuterVolumeSpecName: "model-cache") pod "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" (UID: "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:07:24.893294 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893186    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" (UID: "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:07:24.893294 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893196    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-home" (OuterVolumeSpecName: "home") pod "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" (UID: "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:07:24.893440 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893382    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-model-cache\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:07:24.893440 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893396    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-home\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:07:24.893440 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.893408    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tmp-dir\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:07:24.895292 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.895267    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-dshm" (OuterVolumeSpecName: "dshm") pod "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" (UID: "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:07:24.895427 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.895340    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-kube-api-access-khrqh" (OuterVolumeSpecName: "kube-api-access-khrqh") pod "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" (UID: "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2"). InnerVolumeSpecName "kube-api-access-khrqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:07:24.895427 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.895402    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" (UID: "ccf7d387-214d-4cc6-bfb1-5f12c862b8e2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:07:24.994834 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.994795    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khrqh\" (UniqueName: \"kubernetes.io/projected/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-kube-api-access-khrqh\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:07:24.994834 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.994830    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-dshm\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:07:24.994834 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:24.994841    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2-tls-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:07:25.476771 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.476673    2582 generic.go:356] "Generic (PLEG): container finished" podID="ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" containerID="83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733" exitCode=0
Jul 06 17:07:25.476771 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.476710    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"
Jul 06 17:07:25.476771 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.476752    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv" event={"ID":"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2","Type":"ContainerDied","Data":"83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733"}
Jul 06 17:07:25.477052 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.476795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv" event={"ID":"ccf7d387-214d-4cc6-bfb1-5f12c862b8e2","Type":"ContainerDied","Data":"a0283ba186173bb1dd60310115dae895b736202b997840148c22d67dbfc8cb1d"}
Jul 06 17:07:25.477052 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.476812    2582 scope.go:117] "RemoveContainer" containerID="83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733"
Jul 06 17:07:25.486628 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.486446    2582 scope.go:117] "RemoveContainer" containerID="83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733"
Jul 06 17:07:25.486858 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:07:25.486834    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733\": container with ID starting with 83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733 not found: ID does not exist" containerID="83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733"
Jul 06 17:07:25.486903 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.486860    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733"} err="failed to get container status \"83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733\": rpc error: code = NotFound desc = could not find container \"83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733\": container with ID starting with 83abd8b3d91ea1655a2a5ef0b6f446f956a3c8f2d6af4efb043be739de05b733 not found: ID does not exist"
Jul 06 17:07:25.497048 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.497018    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"]
Jul 06 17:07:25.500792 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:25.500766    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-6ae947/test-model-6ae947-kserve-6b5f874cfc-wcxgv"]
Jul 06 17:07:26.646195 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:26.646162    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" path="/var/lib/kubelet/pods/ccf7d387-214d-4cc6-bfb1-5f12c862b8e2/volumes"
Jul 06 17:07:50.593032 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:07:50.592989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:08:05.796653 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:05.796595    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:08:10.749598 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:10.749558    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:08:10.759404 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:10.759379    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:08:36.802920 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:36.802827    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"]
Jul 06 17:08:36.803368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:36.803108    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy" containerID="cri-o://f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c" gracePeriod=30
Jul 06 17:08:40.494195 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:40.494153    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:08:42.071198 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.071123    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:08:42.129003 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.128968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-data\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129207 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-certs\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129207 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-podinfo\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129207 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129076    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istiod-ca-cert\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129207 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129110    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-envoy\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129207 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129141    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-token\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129473 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129220    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-credential-socket\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129473 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-socket\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129473 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129351    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhpcw\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-kube-api-access-rhpcw\") pod \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\" (UID: \"9921c205-ffa6-4735-9a94-3b24f39b2f9b\") "
Jul 06 17:08:42.129473 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129387    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:42.129724 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129566    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:42.129724 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129587    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:42.129839 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129745    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.129839 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129764    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.129919 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129832    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:08:42.129962 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.129928    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:42.131736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.131696    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:08:42.131868 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.131742    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:42.131973 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.131949    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-kube-api-access-rhpcw" (OuterVolumeSpecName: "kube-api-access-rhpcw") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "kube-api-access-rhpcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:08:42.132020 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.131950    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9921c205-ffa6-4735-9a94-3b24f39b2f9b" (UID: "9921c205-ffa6-4735-9a94-3b24f39b2f9b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:08:42.231084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231031    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.231084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231076    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhpcw\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-kube-api-access-rhpcw\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.231084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231087    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.231084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231095    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.231084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231103    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.231395 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231111    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.231395 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.231118    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9921c205-ffa6-4735-9a94-3b24f39b2f9b-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:42.865157 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.865123    2582 generic.go:356] "Generic (PLEG): container finished" podID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerID="f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c" exitCode=0
Jul 06 17:08:42.865347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.865175    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"
Jul 06 17:08:42.865347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.865219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" event={"ID":"9921c205-ffa6-4735-9a94-3b24f39b2f9b","Type":"ContainerDied","Data":"f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c"}
Jul 06 17:08:42.865347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.865280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22" event={"ID":"9921c205-ffa6-4735-9a94-3b24f39b2f9b","Type":"ContainerDied","Data":"1a95eb2377a8b196f764f9aefab4af6c09781f9b151c756c564482120351d837"}
Jul 06 17:08:42.865347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.865304    2582 scope.go:117] "RemoveContainer" containerID="f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c"
Jul 06 17:08:42.874848 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.874827    2582 scope.go:117] "RemoveContainer" containerID="3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"
Jul 06 17:08:42.882012 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.881986    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"]
Jul 06 17:08:42.883697 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.883670    2582 scope.go:117] "RemoveContainer" containerID="f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c"
Jul 06 17:08:42.884199 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:08:42.884093    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c\": container with ID starting with f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c not found: ID does not exist" containerID="f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c"
Jul 06 17:08:42.884199 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.884131    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c"} err="failed to get container status \"f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c\": rpc error: code = NotFound desc = could not find container \"f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c\": container with ID starting with f383ce1f15bd74192e6c94b2c11158879153072e3d2c69a8d571f8c2e2e4240c not found: ID does not exist"
Jul 06 17:08:42.884199 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.884156    2582 scope.go:117] "RemoveContainer" containerID="3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"
Jul 06 17:08:42.884541 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:08:42.884522    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7\": container with ID starting with 3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7 not found: ID does not exist" containerID="3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"
Jul 06 17:08:42.884585 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.884550    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7"} err="failed to get container status \"3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7\": rpc error: code = NotFound desc = could not find container \"3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7\": container with ID starting with 3451f625a47edfb58ec0e4416bff6214f2046615b1dcab1331f85bb26beda2e7 not found: ID does not exist"
Jul 06 17:08:42.885840 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:42.885821    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c7ba28-openshift-default-5dbb69698c-4vn22"]
Jul 06 17:08:43.787874 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:43.787833    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"]
Jul 06 17:08:43.788319 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:43.788072    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy" containerID="cri-o://f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f" gracePeriod=30
Jul 06 17:08:44.645950 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.645915    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" path="/var/lib/kubelet/pods/9921c205-ffa6-4735-9a94-3b24f39b2f9b/volumes"
Jul 06 17:08:44.679082 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679050    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"]
Jul 06 17:08:44.679437 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679425    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy"
Jul 06 17:08:44.679485 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679438    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy"
Jul 06 17:08:44.679485 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679460    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" containerName="main"
Jul 06 17:08:44.679485 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679466    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" containerName="main"
Jul 06 17:08:44.679575 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679520    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy"
Jul 06 17:08:44.679575 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.679530    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf7d387-214d-4cc6-bfb1-5f12c862b8e2" containerName="main"
Jul 06 17:08:44.684202 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.684179    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.686222 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.686201    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6081ae-openshift-default-dockercfg-2nnrc\""
Jul 06 17:08:44.691462 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.691429    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"]
Jul 06 17:08:44.755923 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.755885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-socket\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756107 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.755933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-credential-socket\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756107 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bmm\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-kube-api-access-s8bmm\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756107 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-token\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756107 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-envoy\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756107 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-podinfo\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756295 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-certs\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756295 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-data\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.756295 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.756250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istiod-ca-cert\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.857445 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-data\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.857445 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istiod-ca-cert\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-socket\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-credential-socket\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bmm\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-kube-api-access-s8bmm\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-token\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-envoy\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-podinfo\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-certs\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.857935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-data\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.858015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-socket\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858465 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.858102    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-credential-socket\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858465 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.858199    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-certs\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.858465 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.858368    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istiod-ca-cert\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.860406 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.860382    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-envoy\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.860628 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.860590    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-podinfo\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.867304 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.866361    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bmm\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-kube-api-access-s8bmm\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.871543 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.871511    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-token\") pod \"e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") " pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:44.996054 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:44.996020    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:45.144588 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.144558    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"]
Jul 06 17:08:45.146789 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:08:45.146753    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6849c2a_aa8a_4657_b6a3_ce07eb1f9f4e.slice/crio-3ac2e53345cd968e91dafda492265f5c1a6cb1d0a45edd26d34a4c6ef3a4260d WatchSource:0}: Error finding container 3ac2e53345cd968e91dafda492265f5c1a6cb1d0a45edd26d34a4c6ef3a4260d: Status 404 returned error can't find the container with id 3ac2e53345cd968e91dafda492265f5c1a6cb1d0a45edd26d34a4c6ef3a4260d
Jul 06 17:08:45.148977 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.148939    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:08:45.149102 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.149012    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:08:45.149102 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.149040    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:08:45.883464 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.883431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" event={"ID":"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e","Type":"ContainerStarted","Data":"acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"}
Jul 06 17:08:45.883937 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.883486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" event={"ID":"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e","Type":"ContainerStarted","Data":"3ac2e53345cd968e91dafda492265f5c1a6cb1d0a45edd26d34a4c6ef3a4260d"}
Jul 06 17:08:45.902550 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.902483    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podStartSLOduration=1.902460681 podStartE2EDuration="1.902460681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:08:45.901142541 +0000 UTC m=+2435.768543769" watchObservedRunningTime="2026-07-06 17:08:45.902460681 +0000 UTC m=+2435.769861910"
Jul 06 17:08:45.996946 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:45.996907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:47.001283 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:47.001250    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:47.893332 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:47.893300    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:47.894277 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:47.894252    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:08:49.069149 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.069120    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:08:49.203895 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.203838    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-data\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.203895 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.203890    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-socket\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.203918    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76690d66-51c5-4279-9674-6c257a67d598-istio-podinfo\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.203947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-credential-socket\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.203996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-envoy\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-certs\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76690d66-51c5-4279-9674-6c257a67d598-istiod-ca-cert\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204081    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-istio-token\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204167 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204125    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl79z\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-kube-api-access-jl79z\") pod \"76690d66-51c5-4279-9674-6c257a67d598\" (UID: \"76690d66-51c5-4279-9674-6c257a67d598\") "
Jul 06 17:08:49.204515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204243    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:49.204515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204371    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:49.204515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204389    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:49.204515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204462    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76690d66-51c5-4279-9674-6c257a67d598-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:08:49.204745 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204594    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.204745 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204636    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.204745 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204641    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-data" (OuterVolumeSpecName: "istio-data") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:49.204745 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204651    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.204745 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.204665    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76690d66-51c5-4279-9674-6c257a67d598-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.206481 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.206457    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76690d66-51c5-4279-9674-6c257a67d598-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:08:49.206570 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.206479    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:08:49.206771 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.206753    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-istio-token" (OuterVolumeSpecName: "istio-token") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:08:49.206771 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.206760    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-kube-api-access-jl79z" (OuterVolumeSpecName: "kube-api-access-jl79z") pod "76690d66-51c5-4279-9674-6c257a67d598" (UID: "76690d66-51c5-4279-9674-6c257a67d598"). InnerVolumeSpecName "kube-api-access-jl79z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:08:49.305715 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.305571    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl79z\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-kube-api-access-jl79z\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.305715 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.305661    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.305715 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.305671    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76690d66-51c5-4279-9674-6c257a67d598-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.305715 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.305681    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76690d66-51c5-4279-9674-6c257a67d598-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.305715 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.305690    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76690d66-51c5-4279-9674-6c257a67d598-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:08:49.904446 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.904410    2582 generic.go:356] "Generic (PLEG): container finished" podID="76690d66-51c5-4279-9674-6c257a67d598" containerID="f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f" exitCode=0
Jul 06 17:08:49.904673 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.904469    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"
Jul 06 17:08:49.904673 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.904490    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" event={"ID":"76690d66-51c5-4279-9674-6c257a67d598","Type":"ContainerDied","Data":"f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f"}
Jul 06 17:08:49.904673 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.904545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87" event={"ID":"76690d66-51c5-4279-9674-6c257a67d598","Type":"ContainerDied","Data":"e3cf148ffd10ef0621a1611633e1d9c4d995408c14ee4106d751dbbba647c47d"}
Jul 06 17:08:49.904673 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.904570    2582 scope.go:117] "RemoveContainer" containerID="f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f"
Jul 06 17:08:49.914431 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.914400    2582 scope.go:117] "RemoveContainer" containerID="c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"
Jul 06 17:08:49.922960 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.922940    2582 scope.go:117] "RemoveContainer" containerID="f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f"
Jul 06 17:08:49.923222 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:08:49.923200    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f\": container with ID starting with f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f not found: ID does not exist" containerID="f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f"
Jul 06 17:08:49.923265 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.923232    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f"} err="failed to get container status \"f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f\": rpc error: code = NotFound desc = could not find container \"f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f\": container with ID starting with f2b75eaca05f498318648f4ba45e286f2f93ef717d6f60b5822425b9b04fca6f not found: ID does not exist"
Jul 06 17:08:49.923265 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.923250    2582 scope.go:117] "RemoveContainer" containerID="c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"
Jul 06 17:08:49.923503 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:08:49.923485    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad\": container with ID starting with c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad not found: ID does not exist" containerID="c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"
Jul 06 17:08:49.923546 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.923511    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad"} err="failed to get container status \"c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad\": rpc error: code = NotFound desc = could not find container \"c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad\": container with ID starting with c3e61c1911c949c081e4bd8d4e69574e1964d37f067f32837e127d63a39771ad not found: ID does not exist"
Jul 06 17:08:49.929573 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.929543    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"]
Jul 06 17:08:49.932925 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:49.932899    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-56aa0f-openshift-default-7f94447485-djt87"]
Jul 06 17:08:50.646624 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:50.646584    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76690d66-51c5-4279-9674-6c257a67d598" path="/var/lib/kubelet/pods/76690d66-51c5-4279-9674-6c257a67d598/volumes"
Jul 06 17:08:53.193242 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193201    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"]
Jul 06 17:08:53.193747 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193725    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy"
Jul 06 17:08:53.193849 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193750    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy"
Jul 06 17:08:53.193849 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193770    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy"
Jul 06 17:08:53.193849 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193778    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy"
Jul 06 17:08:53.193849 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193798    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy"
Jul 06 17:08:53.193849 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193806    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy"
Jul 06 17:08:53.194064 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193923    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy"
Jul 06 17:08:53.194064 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193938    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9921c205-ffa6-4735-9a94-3b24f39b2f9b" containerName="istio-proxy"
Jul 06 17:08:53.194064 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.193951    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="76690d66-51c5-4279-9674-6c257a67d598" containerName="istio-proxy"
Jul 06 17:08:53.198314 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.198267    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.200445 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.200415    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8883ef-openshift-default-dockercfg-2tcqw\""
Jul 06 17:08:53.209237 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.209208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"]
Jul 06 17:08:53.342253 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-data\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342456 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-envoy\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342456 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-podinfo\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342456 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bpwp\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-kube-api-access-5bpwp\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342747 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-token\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342747 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-certs\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342747 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-credential-socket\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342747 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-socket\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.342874 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.342744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6869d2c8-4835-4ed9-b530-00467b1f1804-istiod-ca-cert\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443370 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-podinfo\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443370 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bpwp\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-kube-api-access-5bpwp\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443370 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-token\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443702 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-certs\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443702 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-credential-socket\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443702 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-socket\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443702 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6869d2c8-4835-4ed9-b530-00467b1f1804-istiod-ca-cert\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443702 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-data\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.443702 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-envoy\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.444005 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-certs\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.444005 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443970    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-credential-socket\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.444005 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.443995    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-socket\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.444244 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.444076    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-data\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.444431 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.444393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6869d2c8-4835-4ed9-b530-00467b1f1804-istiod-ca-cert\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.446043 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.446017    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-envoy\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.446171 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.446148    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-podinfo\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.450886 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.450854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-token\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.451004 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.450986    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bpwp\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-kube-api-access-5bpwp\") pod \"e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") " pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.511139 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.511094    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:53.665224 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.665163    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"]
Jul 06 17:08:53.667677 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:08:53.667640    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6869d2c8_4835_4ed9_b530_00467b1f1804.slice/crio-a1af8c255836df9608d17500f3ea223892c8378d5271c518d5ae85018c97cc62 WatchSource:0}: Error finding container a1af8c255836df9608d17500f3ea223892c8378d5271c518d5ae85018c97cc62: Status 404 returned error can't find the container with id a1af8c255836df9608d17500f3ea223892c8378d5271c518d5ae85018c97cc62
Jul 06 17:08:53.670096 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.670047    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:08:53.670231 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.670154    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:08:53.670231 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.670201    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:08:53.694917 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.694842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:08:53.929586 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.929545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" event={"ID":"6869d2c8-4835-4ed9-b530-00467b1f1804","Type":"ContainerStarted","Data":"7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"}
Jul 06 17:08:53.929814 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.929630    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" event={"ID":"6869d2c8-4835-4ed9-b530-00467b1f1804","Type":"ContainerStarted","Data":"a1af8c255836df9608d17500f3ea223892c8378d5271c518d5ae85018c97cc62"}
Jul 06 17:08:53.949648 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:53.949521    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" podStartSLOduration=0.94949954 podStartE2EDuration="949.49954ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:08:53.947996812 +0000 UTC m=+2443.815398042" watchObservedRunningTime="2026-07-06 17:08:53.94949954 +0000 UTC m=+2443.816900769"
Jul 06 17:08:54.512036 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:54.512002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:54.517147 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:54.517117    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:54.938366 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:54.938257    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:08:54.942209 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:08:54.942174    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:02.895029 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:02.894985    2582 patch_prober.go:28] interesting pod/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 17:09:02.895505 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:02.895064    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 17:09:03.007324 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:03.007292    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerID="acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b" exitCode=0
Jul 06 17:09:03.007495 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:03.007370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" event={"ID":"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e","Type":"ContainerDied","Data":"acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"}
Jul 06 17:09:03.007840 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:03.007825    2582 scope.go:117] "RemoveContainer" containerID="acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"
Jul 06 17:09:03.008889 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:03.008859    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:03.008975 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:03.008940    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:03.009020 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:03.008971    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:04.016140 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:04.016105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" event={"ID":"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e","Type":"ContainerStarted","Data":"1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a"}
Jul 06 17:09:04.996691 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:04.996649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:09:04.996924 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:04.996902    2582 patch_prober.go:28] interesting pod/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 17:09:04.996978 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:04.996953    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 17:09:05.695299 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:05.695258    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:09:05.997282 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:05.997251    2582 patch_prober.go:28] interesting pod/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 17:09:05.997451 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:05.997309    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 17:09:06.996876 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:06.996834    2582 patch_prober.go:28] interesting pod/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 17:09:06.997303 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:06.996906    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 17:09:07.997166 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:07.997121    2582 patch_prober.go:28] interesting pod/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 06 17:09:07.997593 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:07.997199    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 06 17:09:08.046281 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:08.046243    2582 generic.go:356] "Generic (PLEG): container finished" podID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerID="7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c" exitCode=0
Jul 06 17:09:08.046585 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:08.046380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" event={"ID":"6869d2c8-4835-4ed9-b530-00467b1f1804","Type":"ContainerDied","Data":"7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"}
Jul 06 17:09:08.047307 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:08.047285    2582 scope.go:117] "RemoveContainer" containerID="7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"
Jul 06 17:09:08.049398 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:08.049354    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:08.049746 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:08.049720    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:08.049972 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:08.049935    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:09.001264 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.001228    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:09:09.001749 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.001526    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:09:09.002337 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.002315    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:09:09.066272 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.065754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" event={"ID":"6869d2c8-4835-4ed9-b530-00467b1f1804","Type":"ContainerStarted","Data":"664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144"}
Jul 06 17:09:09.511794 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.511755    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:09.513018 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.512985    2582 patch_prober.go:28] interesting pod/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 17:09:09.513168 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.513051    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 17:09:09.938394 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:09.938284    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:10.512489 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:10.512447    2582 patch_prober.go:28] interesting pod/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 17:09:10.512964 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:10.512537    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 17:09:11.512118 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:11.512077    2582 patch_prober.go:28] interesting pod/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 17:09:11.512323 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:11.512136    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 17:09:12.512431 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:12.512394    2582 patch_prober.go:28] interesting pod/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 06 17:09:12.512874 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:12.512447    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 06 17:09:13.516975 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:13.516937    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:13.517918 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:13.517900    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:15.203731 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:15.203693    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"]
Jul 06 17:09:15.204186 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:15.203960    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy" containerID="cri-o://1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a" gracePeriod=30
Jul 06 17:09:15.393773 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:15.393736    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:09:20.473648 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.473548    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:09:20.546421 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546373    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-socket\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546421 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546426    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8bmm\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-kube-api-access-s8bmm\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546455    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-podinfo\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546479    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-certs\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546507    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-credential-socket\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546549    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istiod-ca-cert\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546586    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-data\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-envoy\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.546739 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546719    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:20.547103 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546728    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-token\") pod \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\" (UID: \"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e\") "
Jul 06 17:09:20.547103 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546860    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:20.547103 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.546901    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:20.547256 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.547038    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:09:20.547256 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.547190    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.547256 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.547212    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.547256 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.547226    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.547782 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.547749    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:20.549040 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.549010    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:09:20.549130 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.549069    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:20.549130 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.549088    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:09:20.549130 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.549106    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-kube-api-access-s8bmm" (OuterVolumeSpecName: "kube-api-access-s8bmm") pod "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" (UID: "e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e"). InnerVolumeSpecName "kube-api-access-s8bmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:09:20.647904 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.647875    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.647904 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.647898    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.647904 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.647907    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.648134 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.647915    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.648134 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.647923    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8bmm\" (UniqueName: \"kubernetes.io/projected/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-kube-api-access-s8bmm\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:20.648134 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:20.647932    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:21.135263 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.135228    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerID="1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a" exitCode=0
Jul 06 17:09:21.135491 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.135272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" event={"ID":"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e","Type":"ContainerDied","Data":"1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a"}
Jul 06 17:09:21.135491 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.135280    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"
Jul 06 17:09:21.135491 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.135330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9" event={"ID":"e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e","Type":"ContainerDied","Data":"3ac2e53345cd968e91dafda492265f5c1a6cb1d0a45edd26d34a4c6ef3a4260d"}
Jul 06 17:09:21.135491 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.135359    2582 scope.go:117] "RemoveContainer" containerID="1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a"
Jul 06 17:09:21.144525 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.144505    2582 scope.go:117] "RemoveContainer" containerID="acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"
Jul 06 17:09:21.151875 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.151843    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"]
Jul 06 17:09:21.153498 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.153476    2582 scope.go:117] "RemoveContainer" containerID="1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a"
Jul 06 17:09:21.153847 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:09:21.153828    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a\": container with ID starting with 1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a not found: ID does not exist" containerID="1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a"
Jul 06 17:09:21.153932 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.153857    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a"} err="failed to get container status \"1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a\": rpc error: code = NotFound desc = could not find container \"1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a\": container with ID starting with 1ee4e6ae5ad52936c3b7b3c654ba4db4ba483da8d61bea2a8fb22a1254cc4c8a not found: ID does not exist"
Jul 06 17:09:21.153932 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.153875    2582 scope.go:117] "RemoveContainer" containerID="acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"
Jul 06 17:09:21.154136 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:09:21.154119    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b\": container with ID starting with acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b not found: ID does not exist" containerID="acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"
Jul 06 17:09:21.154186 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.154143    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b"} err="failed to get container status \"acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b\": rpc error: code = NotFound desc = could not find container \"acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b\": container with ID starting with acfeb6665d79690c04ab61cbf9ceab92a5192048edb24e5b40c3c4e0caf0738b not found: ID does not exist"
Jul 06 17:09:21.158848 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:21.158822    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6081ae-openshift-default-58d69ddf49-6ksm9"]
Jul 06 17:09:22.186103 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:22.186069    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"]
Jul 06 17:09:22.186566 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:22.186316    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy" containerID="cri-o://664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144" gracePeriod=30
Jul 06 17:09:22.646467 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:22.646429    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" path="/var/lib/kubelet/pods/e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e/volumes"
Jul 06 17:09:23.076084 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076053    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"]
Jul 06 17:09:23.076482 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076468    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy"
Jul 06 17:09:23.076526 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076485    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy"
Jul 06 17:09:23.076526 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076499    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy"
Jul 06 17:09:23.076526 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076505    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy"
Jul 06 17:09:23.076658 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076574    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy"
Jul 06 17:09:23.076658 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.076582    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6849c2a-aa8a-4657-b6a3-ce07eb1f9f4e" containerName="istio-proxy"
Jul 06 17:09:23.079902 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.079880    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.081962 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.081939    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0874ce-openshift-default-dockercfg-xhdtc\""
Jul 06 17:09:23.090363 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.090335    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"]
Jul 06 17:09:23.171552 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-istio-token\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171552 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-credential-socket\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-envoy\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ef8aa7-e610-472c-8005-2b3868393317-istio-podinfo\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-socket\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-data\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58pj\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-kube-api-access-k58pj\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ef8aa7-e610-472c-8005-2b3868393317-istiod-ca-cert\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.171851 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.171833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-certs\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273033 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.272986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-istio-token\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273033 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-credential-socket\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-envoy\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ef8aa7-e610-472c-8005-2b3868393317-istio-podinfo\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-socket\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-data\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58pj\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-kube-api-access-k58pj\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ef8aa7-e610-472c-8005-2b3868393317-istiod-ca-cert\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-certs\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273492    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-credential-socket\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.273644 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273535    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-socket\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.274120 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-data\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.274120 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.273857    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-certs\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.274258 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.274135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ef8aa7-e610-472c-8005-2b3868393317-istiod-ca-cert\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.275531 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.275510    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-envoy\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.275925 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.275906    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ef8aa7-e610-472c-8005-2b3868393317-istio-podinfo\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.280586 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.280562    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-istio-token\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.280811 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.280790    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58pj\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-kube-api-access-k58pj\") pod \"e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") " pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.392008 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.391912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:23.536493 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.536445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"]
Jul 06 17:09:23.539358 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:09:23.539325    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ef8aa7_e610_472c_8005_2b3868393317.slice/crio-4b7d29e48f95c8ccb01b59100ef01d11ae1428a66911543a8d86fcadda98e27b WatchSource:0}: Error finding container 4b7d29e48f95c8ccb01b59100ef01d11ae1428a66911543a8d86fcadda98e27b: Status 404 returned error can't find the container with id 4b7d29e48f95c8ccb01b59100ef01d11ae1428a66911543a8d86fcadda98e27b
Jul 06 17:09:23.541577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.541543    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:23.541671 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.541631    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:23.541671 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:23.541658    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:24.158902 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:24.158861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" event={"ID":"13ef8aa7-e610-472c-8005-2b3868393317","Type":"ContainerStarted","Data":"60bde26578913071252a91f9ef786b89a6a25afd3cdb13e572ce2641b2f7af90"}
Jul 06 17:09:24.159112 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:24.158939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" event={"ID":"13ef8aa7-e610-472c-8005-2b3868393317","Type":"ContainerStarted","Data":"4b7d29e48f95c8ccb01b59100ef01d11ae1428a66911543a8d86fcadda98e27b"}
Jul 06 17:09:24.177245 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:24.177188    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podStartSLOduration=1.177171369 podStartE2EDuration="1.177171369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:09:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:09:24.175233961 +0000 UTC m=+2474.042635180" watchObservedRunningTime="2026-07-06 17:09:24.177171369 +0000 UTC m=+2474.044572596"
Jul 06 17:09:24.392418 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:24.392371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:24.397962 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:24.397932    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:25.164406 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:25.164374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:25.165268 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:25.165250    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:25.189882 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:25.189842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:09:27.460515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.460445    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:27.619515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-data\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619515 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619523    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-envoy\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-certs\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619651    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bpwp\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-kube-api-access-5bpwp\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619689    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-token\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6869d2c8-4835-4ed9-b530-00467b1f1804-istiod-ca-cert\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619757    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-socket\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.619827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-podinfo\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.620200 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619873    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-credential-socket\") pod \"6869d2c8-4835-4ed9-b530-00467b1f1804\" (UID: \"6869d2c8-4835-4ed9-b530-00467b1f1804\") "
Jul 06 17:09:27.620200 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.619943    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:27.620200 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620167    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:27.620200 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620182    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:27.620390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620268    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.620390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620285    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.620390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620300    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.620390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620355    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-data" (OuterVolumeSpecName: "istio-data") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:27.620390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.620362    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6869d2c8-4835-4ed9-b530-00467b1f1804-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:09:27.622071 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.622047    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-token" (OuterVolumeSpecName: "istio-token") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:09:27.622198 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.622142    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:09:27.622274 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.622227    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:09:27.622274 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.622232    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-kube-api-access-5bpwp" (OuterVolumeSpecName: "kube-api-access-5bpwp") pod "6869d2c8-4835-4ed9-b530-00467b1f1804" (UID: "6869d2c8-4835-4ed9-b530-00467b1f1804"). InnerVolumeSpecName "kube-api-access-5bpwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:09:27.721150 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.721063    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.721150 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.721091    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.721334 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.721176    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.721334 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.721294    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bpwp\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-kube-api-access-5bpwp\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.721334 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.721316    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6869d2c8-4835-4ed9-b530-00467b1f1804-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:27.721334 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:27.721325    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6869d2c8-4835-4ed9-b530-00467b1f1804-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:09:28.181944 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.181911    2582 generic.go:356] "Generic (PLEG): container finished" podID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerID="664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144" exitCode=0
Jul 06 17:09:28.182128 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.181967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" event={"ID":"6869d2c8-4835-4ed9-b530-00467b1f1804","Type":"ContainerDied","Data":"664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144"}
Jul 06 17:09:28.182128 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.181991    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"
Jul 06 17:09:28.182128 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.182019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r" event={"ID":"6869d2c8-4835-4ed9-b530-00467b1f1804","Type":"ContainerDied","Data":"a1af8c255836df9608d17500f3ea223892c8378d5271c518d5ae85018c97cc62"}
Jul 06 17:09:28.182128 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.182042    2582 scope.go:117] "RemoveContainer" containerID="664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144"
Jul 06 17:09:28.192264 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.192244    2582 scope.go:117] "RemoveContainer" containerID="7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"
Jul 06 17:09:28.202518 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.202500    2582 scope.go:117] "RemoveContainer" containerID="664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144"
Jul 06 17:09:28.202820 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:09:28.202798    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144\": container with ID starting with 664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144 not found: ID does not exist" containerID="664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144"
Jul 06 17:09:28.202923 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.202828    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144"} err="failed to get container status \"664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144\": rpc error: code = NotFound desc = could not find container \"664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144\": container with ID starting with 664a790f5bc8386da933271926ffc754bda80f432aaa325a5f8aaccc153dd144 not found: ID does not exist"
Jul 06 17:09:28.202923 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.202846    2582 scope.go:117] "RemoveContainer" containerID="7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"
Jul 06 17:09:28.203058 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:09:28.203040    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c\": container with ID starting with 7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c not found: ID does not exist" containerID="7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"
Jul 06 17:09:28.203095 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.203064    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c"} err="failed to get container status \"7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c\": rpc error: code = NotFound desc = could not find container \"7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c\": container with ID starting with 7fdb9da68aa46e0fde8d2df4bae5435ac8e98e58d1a2d1259b47d12caff6be5c not found: ID does not exist"
Jul 06 17:09:28.206013 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.205988    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"]
Jul 06 17:09:28.210006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.209985    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8883ef-openshift-default-758b95d497-vqs9r"]
Jul 06 17:09:28.645571 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:28.645539    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" path="/var/lib/kubelet/pods/6869d2c8-4835-4ed9-b530-00467b1f1804/volumes"
Jul 06 17:09:31.433860 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.433823    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"]
Jul 06 17:09:31.434475 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.434240    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy"
Jul 06 17:09:31.434475 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.434258    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy"
Jul 06 17:09:31.434475 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.434287    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy"
Jul 06 17:09:31.434475 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.434296    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy"
Jul 06 17:09:31.434475 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.434381    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy"
Jul 06 17:09:31.434475 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.434389    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6869d2c8-4835-4ed9-b530-00467b1f1804" containerName="istio-proxy"
Jul 06 17:09:31.437116 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.437090    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.439090 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.439069    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d073f6-openshift-default-dockercfg-f5nhz\""
Jul 06 17:09:31.448871 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.448842    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"]
Jul 06 17:09:31.557137 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-socket\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc97b47-303d-4e27-bc15-e3758e653539-istiod-ca-cert\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-data\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557244    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-envoy\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-certs\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj28l\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-kube-api-access-pj28l\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557355 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc97b47-303d-4e27-bc15-e3758e653539-istio-podinfo\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557701 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-istio-token\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.557701 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.557488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-credential-socket\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.658731 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-envoy\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.658899 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-certs\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.658899 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj28l\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-kube-api-access-pj28l\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.658899 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658811    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc97b47-303d-4e27-bc15-e3758e653539-istio-podinfo\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.658899 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-istio-token\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.658899 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-credential-socket\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659226 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.658946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-socket\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659226 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc97b47-303d-4e27-bc15-e3758e653539-istiod-ca-cert\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659226 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-data\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659226 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659173    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-certs\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659440 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659335    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-credential-socket\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659440 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659364    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-data\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659570 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659456    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-socket\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.659931 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.659906    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc97b47-303d-4e27-bc15-e3758e653539-istiod-ca-cert\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.661019 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.660999    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-envoy\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.662149 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.662129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc97b47-303d-4e27-bc15-e3758e653539-istio-podinfo\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.666154 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.666128    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-istio-token\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.666424 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.666395    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj28l\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-kube-api-access-pj28l\") pod \"e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") " pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.749069 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.749023    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:31.903538 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.903510    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"]
Jul 06 17:09:31.905367 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:09:31.905333    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc97b47_303d_4e27_bc15_e3758e653539.slice/crio-f562f5c80c91735cd3abadf216b1514eab838c3f6d222ba6166296b060e9d2da WatchSource:0}: Error finding container f562f5c80c91735cd3abadf216b1514eab838c3f6d222ba6166296b060e9d2da: Status 404 returned error can't find the container with id f562f5c80c91735cd3abadf216b1514eab838c3f6d222ba6166296b060e9d2da
Jul 06 17:09:31.907758 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.907715    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:31.907866 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.907816    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:31.907906 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:31.907864    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:32.205589 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:32.205482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" event={"ID":"fdc97b47-303d-4e27-bc15-e3758e653539","Type":"ContainerStarted","Data":"2a8513697a76ab295d833b21891af3b220bbb7aa3b9beca091860e6b60581c85"}
Jul 06 17:09:32.205589 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:32.205546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" event={"ID":"fdc97b47-303d-4e27-bc15-e3758e653539","Type":"ContainerStarted","Data":"f562f5c80c91735cd3abadf216b1514eab838c3f6d222ba6166296b060e9d2da"}
Jul 06 17:09:32.223410 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:32.223354    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podStartSLOduration=1.223336569 podStartE2EDuration="1.223336569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:09:32.222538859 +0000 UTC m=+2482.089940086" watchObservedRunningTime="2026-07-06 17:09:32.223336569 +0000 UTC m=+2482.090737841"
Jul 06 17:09:32.750122 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:32.750032    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:32.757479 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:32.757446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:33.210679 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:33.210556    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:33.211714 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:33.211692    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:35.292411 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:35.292368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:09:39.241235 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:39.241201    2582 generic.go:356] "Generic (PLEG): container finished" podID="13ef8aa7-e610-472c-8005-2b3868393317" containerID="60bde26578913071252a91f9ef786b89a6a25afd3cdb13e572ce2641b2f7af90" exitCode=0
Jul 06 17:09:39.241712 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:39.241252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" event={"ID":"13ef8aa7-e610-472c-8005-2b3868393317","Type":"ContainerDied","Data":"60bde26578913071252a91f9ef786b89a6a25afd3cdb13e572ce2641b2f7af90"}
Jul 06 17:09:39.241712 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:39.241643    2582 scope.go:117] "RemoveContainer" containerID="60bde26578913071252a91f9ef786b89a6a25afd3cdb13e572ce2641b2f7af90"
Jul 06 17:09:39.242788 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:39.242754    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:39.242891 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:39.242832    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:39.242891 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:39.242867    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:40.165201 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:40.165093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:40.252046 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:40.252001    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" event={"ID":"13ef8aa7-e610-472c-8005-2b3868393317","Type":"ContainerStarted","Data":"8e9714719665605feb25d4605a83d08c1095beafd805f15acfe0884a256ba06a"}
Jul 06 17:09:40.392577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:40.392538    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:40.393956 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:40.393927    2582 patch_prober.go:28] interesting pod/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 17:09:40.394115 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:40.393987    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 17:09:41.393407 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:41.393359    2582 patch_prober.go:28] interesting pod/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 17:09:41.393853 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:41.393420    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 17:09:42.392785 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:42.392746    2582 patch_prober.go:28] interesting pod/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 17:09:42.392979 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:42.392814    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 17:09:43.392866 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:43.392822    2582 patch_prober.go:28] interesting pod/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 17:09:43.393280 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:43.392880    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 17:09:44.004797 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:44.004747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:09:44.392678 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:44.392552    2582 patch_prober.go:28] interesting pod/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 06 17:09:44.392678 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:44.392657    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 06 17:09:45.397085 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:45.397049    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:45.397565 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:45.397345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:45.398105 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:45.398085    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:09:48.212695 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.212657    2582 patch_prober.go:28] interesting pod/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 17:09:48.213133 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.212716    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 17:09:48.319978 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.319946    2582 generic.go:356] "Generic (PLEG): container finished" podID="fdc97b47-303d-4e27-bc15-e3758e653539" containerID="2a8513697a76ab295d833b21891af3b220bbb7aa3b9beca091860e6b60581c85" exitCode=0
Jul 06 17:09:48.320164 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.320026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" event={"ID":"fdc97b47-303d-4e27-bc15-e3758e653539","Type":"ContainerDied","Data":"2a8513697a76ab295d833b21891af3b220bbb7aa3b9beca091860e6b60581c85"}
Jul 06 17:09:48.320482 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.320456    2582 scope.go:117] "RemoveContainer" containerID="2a8513697a76ab295d833b21891af3b220bbb7aa3b9beca091860e6b60581c85"
Jul 06 17:09:48.321657 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.321629    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:48.321725 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.321710    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:48.321784 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:48.321771    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 06 17:09:49.327161 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:49.327124    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" event={"ID":"fdc97b47-303d-4e27-bc15-e3758e653539","Type":"ContainerStarted","Data":"f13ff97219fba53f631617e88001c5b80be6a866fc10060c56c27ed035bc74a6"}
Jul 06 17:09:49.750006 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:49.749960    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:49.750236 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:49.750102    2582 patch_prober.go:28] interesting pod/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 17:09:49.750236 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:49.750144    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 17:09:50.750287 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:50.750235    2582 patch_prober.go:28] interesting pod/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 17:09:50.750862 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:50.750335    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 17:09:51.750550 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:51.750502    2582 patch_prober.go:28] interesting pod/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 17:09:51.751125 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:51.750580    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 17:09:52.750628 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:52.750098    2582 patch_prober.go:28] interesting pod/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 06 17:09:52.750628 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:52.750169    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 06 17:09:53.753905 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:53.753871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:53.754314 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:53.754173    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:53.754821 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:53.754803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:09:57.688516 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:09:57.688478    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:10:28.288467 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:10:28.288423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:10:47.686675 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:10:47.686636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:11:03.189347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:11:03.189304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:11:16.300229 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:11:16.300187    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:11:31.787880 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:11:31.787845    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:11:48.389633 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:11:48.389523    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:12:03.794262 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:12:03.794221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:12:19.390709 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:12:19.390672    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:12:34.799105 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:12:34.799066    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:13:00.195538 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:00.195491    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:13:10.781014 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:10.780921    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:13:10.790179 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:10.790152    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:13:19.498201 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:19.498156    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:13:38.393743 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:38.393708    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:13:54.691892 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.691860    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"]
Jul 06 17:13:54.694319 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.694298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.697347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.697315    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0874ce\"/\"default-dockercfg-7lm4w\""
Jul 06 17:13:54.697508 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.697319    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0874ce\"/\"openshift-service-ca.crt\""
Jul 06 17:13:54.697508 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.697319    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0874ce\"/\"rate-test-model-0874ce-kserve-self-signed-certs\""
Jul 06 17:13:54.697508 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.697316    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0874ce\"/\"kube-root-ca.crt\""
Jul 06 17:13:54.704368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.703700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e44d08bd-be71-4ae1-9ebe-3fa190691027-tls-certs\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.704368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.703761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-dshm\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.704368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.703878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-tmp-dir\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.704368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.703907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-home\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.704368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.703946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62crx\" (UniqueName: \"kubernetes.io/projected/e44d08bd-be71-4ae1-9ebe-3fa190691027-kube-api-access-62crx\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.704368 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.703984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-model-cache\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.706269 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.706243    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"]
Jul 06 17:13:54.804931 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.804894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-home\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.804931 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.804941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62crx\" (UniqueName: \"kubernetes.io/projected/e44d08bd-be71-4ae1-9ebe-3fa190691027-kube-api-access-62crx\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805217 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.804966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-model-cache\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805217 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.805021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e44d08bd-be71-4ae1-9ebe-3fa190691027-tls-certs\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805217 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.805043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-dshm\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805217 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.805109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-tmp-dir\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805388 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.805308    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-home\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805423 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.805400    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-model-cache\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.805491 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.805465    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-tmp-dir\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.807531 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.807495    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-dshm\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.807691 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.807676    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e44d08bd-be71-4ae1-9ebe-3fa190691027-tls-certs\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:54.813737 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:54.813701    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62crx\" (UniqueName: \"kubernetes.io/projected/e44d08bd-be71-4ae1-9ebe-3fa190691027-kube-api-access-62crx\") pod \"rate-test-model-0874ce-kserve-785dbdfc59-2v585\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") " pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:55.005941 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:55.005897    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:13:55.145205 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:55.145177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"]
Jul 06 17:13:55.147658 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:13:55.147618    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode44d08bd_be71_4ae1_9ebe_3fa190691027.slice/crio-893473bf2bbe8ff4b91269c7ba2947ebdc7a85b5aaa7a32571c26c3314e40049 WatchSource:0}: Error finding container 893473bf2bbe8ff4b91269c7ba2947ebdc7a85b5aaa7a32571c26c3314e40049: Status 404 returned error can't find the container with id 893473bf2bbe8ff4b91269c7ba2947ebdc7a85b5aaa7a32571c26c3314e40049
Jul 06 17:13:55.569706 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:55.569664    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585" event={"ID":"e44d08bd-be71-4ae1-9ebe-3fa190691027","Type":"ContainerStarted","Data":"e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec"}
Jul 06 17:13:55.569874 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:55.569719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585" event={"ID":"e44d08bd-be71-4ae1-9ebe-3fa190691027","Type":"ContainerStarted","Data":"893473bf2bbe8ff4b91269c7ba2947ebdc7a85b5aaa7a32571c26c3314e40049"}
Jul 06 17:13:55.585136 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:55.585082    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585" podStartSLOduration=1.585042469 podStartE2EDuration="1.585042469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:13:55.583735018 +0000 UTC m=+2745.451136278" watchObservedRunningTime="2026-07-06 17:13:55.585042469 +0000 UTC m=+2745.452443697"
Jul 06 17:13:55.589042 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:13:55.589006    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:14:05.006324 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:05.006276    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:14:05.006900 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:05.006341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:14:05.021208 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:05.021041    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:14:05.638087 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:05.638048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:14:06.795253 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:06.795221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:14:41.089127 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:41.089088    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:14:59.296221 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:14:59.296182    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:15:13.991556 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:13.991519    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:15:20.767072 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:20.767031    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"]
Jul 06 17:15:27.395004 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:27.394953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:15:35.790021 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:35.789969    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585" podUID="e44d08bd-be71-4ae1-9ebe-3fa190691027" containerName="main" containerID="cri-o://e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec" gracePeriod=45
Jul 06 17:15:36.054679 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.054596    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:15:36.082522 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.082484    2582 generic.go:356] "Generic (PLEG): container finished" podID="e44d08bd-be71-4ae1-9ebe-3fa190691027" containerID="e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec" exitCode=0
Jul 06 17:15:36.082737 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.082528    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"
Jul 06 17:15:36.082737 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.082541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585" event={"ID":"e44d08bd-be71-4ae1-9ebe-3fa190691027","Type":"ContainerDied","Data":"e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec"}
Jul 06 17:15:36.082737 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.082584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585" event={"ID":"e44d08bd-be71-4ae1-9ebe-3fa190691027","Type":"ContainerDied","Data":"893473bf2bbe8ff4b91269c7ba2947ebdc7a85b5aaa7a32571c26c3314e40049"}
Jul 06 17:15:36.082737 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.082615    2582 scope.go:117] "RemoveContainer" containerID="e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec"
Jul 06 17:15:36.091488 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.091466    2582 scope.go:117] "RemoveContainer" containerID="e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec"
Jul 06 17:15:36.091875 ip-10-0-138-170 kubenswrapper[2582]: E0706 17:15:36.091850    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec\": container with ID starting with e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec not found: ID does not exist" containerID="e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec"
Jul 06 17:15:36.091951 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.091891    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec"} err="failed to get container status \"e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec\": rpc error: code = NotFound desc = could not find container \"e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec\": container with ID starting with e3efa41c6681fe7d48152874bb40ddd4fe50cedd7ef82a8f4decfabdf05e6fec not found: ID does not exist"
Jul 06 17:15:36.196252 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196217    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-model-cache\") pod \"e44d08bd-be71-4ae1-9ebe-3fa190691027\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") "
Jul 06 17:15:36.196466 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196356    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e44d08bd-be71-4ae1-9ebe-3fa190691027-tls-certs\") pod \"e44d08bd-be71-4ae1-9ebe-3fa190691027\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") "
Jul 06 17:15:36.196466 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196408    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-tmp-dir\") pod \"e44d08bd-be71-4ae1-9ebe-3fa190691027\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") "
Jul 06 17:15:36.196466 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62crx\" (UniqueName: \"kubernetes.io/projected/e44d08bd-be71-4ae1-9ebe-3fa190691027-kube-api-access-62crx\") pod \"e44d08bd-be71-4ae1-9ebe-3fa190691027\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") "
Jul 06 17:15:36.196663 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196465    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-dshm\") pod \"e44d08bd-be71-4ae1-9ebe-3fa190691027\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") "
Jul 06 17:15:36.196663 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196486    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-home\") pod \"e44d08bd-be71-4ae1-9ebe-3fa190691027\" (UID: \"e44d08bd-be71-4ae1-9ebe-3fa190691027\") "
Jul 06 17:15:36.196663 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196494    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-model-cache" (OuterVolumeSpecName: "model-cache") pod "e44d08bd-be71-4ae1-9ebe-3fa190691027" (UID: "e44d08bd-be71-4ae1-9ebe-3fa190691027"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:36.196818 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196740    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e44d08bd-be71-4ae1-9ebe-3fa190691027" (UID: "e44d08bd-be71-4ae1-9ebe-3fa190691027"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:36.196818 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196770    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-home" (OuterVolumeSpecName: "home") pod "e44d08bd-be71-4ae1-9ebe-3fa190691027" (UID: "e44d08bd-be71-4ae1-9ebe-3fa190691027"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:36.196928 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196898    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-home\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:36.196928 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196912    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-model-cache\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:36.196928 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.196923    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-tmp-dir\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:36.198826 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.198799    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44d08bd-be71-4ae1-9ebe-3fa190691027-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e44d08bd-be71-4ae1-9ebe-3fa190691027" (UID: "e44d08bd-be71-4ae1-9ebe-3fa190691027"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:15:36.198950 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.198835    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-dshm" (OuterVolumeSpecName: "dshm") pod "e44d08bd-be71-4ae1-9ebe-3fa190691027" (UID: "e44d08bd-be71-4ae1-9ebe-3fa190691027"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:36.198950 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.198910    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44d08bd-be71-4ae1-9ebe-3fa190691027-kube-api-access-62crx" (OuterVolumeSpecName: "kube-api-access-62crx") pod "e44d08bd-be71-4ae1-9ebe-3fa190691027" (UID: "e44d08bd-be71-4ae1-9ebe-3fa190691027"). InnerVolumeSpecName "kube-api-access-62crx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:15:36.297684 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.297646    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e44d08bd-be71-4ae1-9ebe-3fa190691027-tls-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:36.297684 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.297679    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62crx\" (UniqueName: \"kubernetes.io/projected/e44d08bd-be71-4ae1-9ebe-3fa190691027-kube-api-access-62crx\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:36.297684 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.297689    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e44d08bd-be71-4ae1-9ebe-3fa190691027-dshm\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:36.403776 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.403743    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"]
Jul 06 17:15:36.407356 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.407328    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0874ce/rate-test-model-0874ce-kserve-785dbdfc59-2v585"]
Jul 06 17:15:36.646179 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:36.646094    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e44d08bd-be71-4ae1-9ebe-3fa190691027" path="/var/lib/kubelet/pods/e44d08bd-be71-4ae1-9ebe-3fa190691027/volumes"
Jul 06 17:15:38.190469 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:38.190434    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:15:38.924081 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:38.924036    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"]
Jul 06 17:15:38.924333 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:38.924301    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy" containerID="cri-o://8e9714719665605feb25d4605a83d08c1095beafd805f15acfe0884a256ba06a" gracePeriod=30
Jul 06 17:15:44.129021 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.128986    2582 generic.go:356] "Generic (PLEG): container finished" podID="13ef8aa7-e610-472c-8005-2b3868393317" containerID="8e9714719665605feb25d4605a83d08c1095beafd805f15acfe0884a256ba06a" exitCode=0
Jul 06 17:15:44.129581 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.129073    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" event={"ID":"13ef8aa7-e610-472c-8005-2b3868393317","Type":"ContainerDied","Data":"8e9714719665605feb25d4605a83d08c1095beafd805f15acfe0884a256ba06a"}
Jul 06 17:15:44.129581 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.129195    2582 scope.go:117] "RemoveContainer" containerID="60bde26578913071252a91f9ef786b89a6a25afd3cdb13e572ce2641b2f7af90"
Jul 06 17:15:44.189116 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.189044    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:15:44.376376 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376337    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-certs\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376388    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ef8aa7-e610-472c-8005-2b3868393317-istiod-ca-cert\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376413    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-data\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k58pj\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-kube-api-access-k58pj\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376498    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-credential-socket\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376527    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ef8aa7-e610-472c-8005-2b3868393317-istio-podinfo\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376577 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376557    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-socket\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376949 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376586    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-envoy\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.376949 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376680    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:44.376949 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-istio-token\") pod \"13ef8aa7-e610-472c-8005-2b3868393317\" (UID: \"13ef8aa7-e610-472c-8005-2b3868393317\") "
Jul 06 17:15:44.377301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376941    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13ef8aa7-e610-472c-8005-2b3868393317-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:15:44.377301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.376988    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:44.377301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.377107    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.377301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.377125    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ef8aa7-e610-472c-8005-2b3868393317-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.377301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.377138    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.377301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.377205    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:44.377643 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.377416    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-data" (OuterVolumeSpecName: "istio-data") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:44.378929 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.378904    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13ef8aa7-e610-472c-8005-2b3868393317-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:15:44.379044 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.379016    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-kube-api-access-k58pj" (OuterVolumeSpecName: "kube-api-access-k58pj") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "kube-api-access-k58pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:15:44.379240 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.379217    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-istio-token" (OuterVolumeSpecName: "istio-token") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:15:44.379297 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.379219    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13ef8aa7-e610-472c-8005-2b3868393317" (UID: "13ef8aa7-e610-472c-8005-2b3868393317"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:44.478736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.478581    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ef8aa7-e610-472c-8005-2b3868393317-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.478736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.478668    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.478736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.478683    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.478736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.478698    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.478736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.478710    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ef8aa7-e610-472c-8005-2b3868393317-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:44.478736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:44.478721    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k58pj\" (UniqueName: \"kubernetes.io/projected/13ef8aa7-e610-472c-8005-2b3868393317-kube-api-access-k58pj\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:45.134846 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.134813    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"
Jul 06 17:15:45.135286 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.134848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh" event={"ID":"13ef8aa7-e610-472c-8005-2b3868393317","Type":"ContainerDied","Data":"4b7d29e48f95c8ccb01b59100ef01d11ae1428a66911543a8d86fcadda98e27b"}
Jul 06 17:15:45.135286 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.134911    2582 scope.go:117] "RemoveContainer" containerID="8e9714719665605feb25d4605a83d08c1095beafd805f15acfe0884a256ba06a"
Jul 06 17:15:45.154347 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.154312    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"]
Jul 06 17:15:45.158647 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.158616    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0874ce-openshift-default-5c5554778c-wdhdh"]
Jul 06 17:15:45.943372 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.943327    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"]
Jul 06 17:15:45.943649 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:45.943621    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy" containerID="cri-o://f13ff97219fba53f631617e88001c5b80be6a866fc10060c56c27ed035bc74a6" gracePeriod=30
Jul 06 17:15:46.645911 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:46.645873    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13ef8aa7-e610-472c-8005-2b3868393317" path="/var/lib/kubelet/pods/13ef8aa7-e610-472c-8005-2b3868393317/volumes"
Jul 06 17:15:48.287348 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:48.287303    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8zc86"]
Jul 06 17:15:51.170872 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.170836    2582 generic.go:356] "Generic (PLEG): container finished" podID="fdc97b47-303d-4e27-bc15-e3758e653539" containerID="f13ff97219fba53f631617e88001c5b80be6a866fc10060c56c27ed035bc74a6" exitCode=0
Jul 06 17:15:51.171298 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.170907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" event={"ID":"fdc97b47-303d-4e27-bc15-e3758e653539","Type":"ContainerDied","Data":"f13ff97219fba53f631617e88001c5b80be6a866fc10060c56c27ed035bc74a6"}
Jul 06 17:15:51.171298 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.170977    2582 scope.go:117] "RemoveContainer" containerID="2a8513697a76ab295d833b21891af3b220bbb7aa3b9beca091860e6b60581c85"
Jul 06 17:15:51.211808 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.211731    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:15:51.241918 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.241879    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc97b47-303d-4e27-bc15-e3758e653539-istio-podinfo\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242110 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.241941    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-data\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242110 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.241992    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-socket\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242110 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242055    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj28l\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-kube-api-access-pj28l\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242276 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242113    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-certs\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242276 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242152    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-credential-socket\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242276 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242179    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-envoy\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242276 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242205    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc97b47-303d-4e27-bc15-e3758e653539-istiod-ca-cert\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242487 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242278    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-istio-token\") pod \"fdc97b47-303d-4e27-bc15-e3758e653539\" (UID: \"fdc97b47-303d-4e27-bc15-e3758e653539\") "
Jul 06 17:15:51.242487 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242276    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:51.242623 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242585    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.242763 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242730    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:51.242845 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242821    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:51.242932 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242905    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdc97b47-303d-4e27-bc15-e3758e653539-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:15:51.243017 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.242975    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:51.244461 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.244426    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-kube-api-access-pj28l" (OuterVolumeSpecName: "kube-api-access-pj28l") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "kube-api-access-pj28l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:15:51.244593 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.244492    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdc97b47-303d-4e27-bc15-e3758e653539-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 17:15:51.244827 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.244805    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:15:51.244893 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.244869    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdc97b47-303d-4e27-bc15-e3758e653539" (UID: "fdc97b47-303d-4e27-bc15-e3758e653539"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:15:51.343123 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343089    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-workload-certs\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343123 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343121    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-credential-socket\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343346 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343135    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-envoy\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343346 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343149    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdc97b47-303d-4e27-bc15-e3758e653539-istiod-ca-cert\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343346 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343160    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-istio-token\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343346 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343171    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdc97b47-303d-4e27-bc15-e3758e653539-istio-podinfo\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343346 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343182    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdc97b47-303d-4e27-bc15-e3758e653539-istio-data\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.343346 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.343195    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj28l\" (UniqueName: \"kubernetes.io/projected/fdc97b47-303d-4e27-bc15-e3758e653539-kube-api-access-pj28l\") on node \"ip-10-0-138-170.ec2.internal\" DevicePath \"\""
Jul 06 17:15:51.586043 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.586013    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v7fr7_eef37e1f-b694-4263-8c1e-917f583cbb43/manager/0.log"
Jul 06 17:15:51.727540 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:51.727502    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dhrz2_55c490b0-739f-4688-8c35-e9d09eada6e6/manager/0.log"
Jul 06 17:15:52.176883 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.176852    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"
Jul 06 17:15:52.176883 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.176873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j" event={"ID":"fdc97b47-303d-4e27-bc15-e3758e653539","Type":"ContainerDied","Data":"f562f5c80c91735cd3abadf216b1514eab838c3f6d222ba6166296b060e9d2da"}
Jul 06 17:15:52.177485 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.176927    2582 scope.go:117] "RemoveContainer" containerID="f13ff97219fba53f631617e88001c5b80be6a866fc10060c56c27ed035bc74a6"
Jul 06 17:15:52.197777 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.197738    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"]
Jul 06 17:15:52.205415 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.205380    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d073f6-openshift-default-97b5447d7-vkb6j"]
Jul 06 17:15:52.550552 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.550522    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pflnn_77c99348-d9f3-4fc6-b06f-db701aa287cb/server/0.log"
Jul 06 17:15:52.646191 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.646145    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" path="/var/lib/kubelet/pods/fdc97b47-303d-4e27-bc15-e3758e653539/volumes"
Jul 06 17:15:52.811563 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.811481    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-px5gf_5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe/manager/0.log"
Jul 06 17:15:52.818559 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:52.818531    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-px5gf_5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe/copy-manifests/0.log"
Jul 06 17:15:54.964590 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:54.964560    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-knpbt_8255c0f6-3493-425b-9652-2d961fbc57a7/manager/0.log"
Jul 06 17:15:55.081855 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:55.081826    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hlfdb_6e78e8b8-5391-4706-864a-52384cb014c0/kuadrant-console-plugin/0.log"
Jul 06 17:15:55.457255 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:55.457217    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8zc86_15b30428-4c5a-4e9d-b012-1c93eb5301e3/limitador/0.log"
Jul 06 17:15:55.580732 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:55.580690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rsm9v_f3af711d-91a3-4b08-a5ba-9df27a2a832b/manager/0.log"
Jul 06 17:15:55.956388 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:55.956353    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l29kk_24ab8814-3323-449e-8ead-a354c5f93703/istio-proxy/0.log"
Jul 06 17:15:56.464689 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:56.464657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/1.log"
Jul 06 17:15:57.758209 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:15:57.758174    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-f6vhm_726ef1f8-55af-4d8b-9c10-fa944111c2ea/main/0.log"
Jul 06 17:16:05.504946 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:05.504853    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vltrc_40211381-eaa5-4224-907c-0d3d4acb9f35/global-pull-secret-syncer/0.log"
Jul 06 17:16:05.641047 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:05.641007    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xcgvc_936fd11e-6dbe-4f8e-b0cc-fd72d8bace7a/konnectivity-agent/0.log"
Jul 06 17:16:05.669516 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:05.669486    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-170.ec2.internal_84fd94ad0deba4a780d6c891a29cfb51/haproxy/0.log"
Jul 06 17:16:10.660816 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:10.660728    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-knpbt_8255c0f6-3493-425b-9652-2d961fbc57a7/manager/0.log"
Jul 06 17:16:10.688056 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:10.688029    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hlfdb_6e78e8b8-5391-4706-864a-52384cb014c0/kuadrant-console-plugin/0.log"
Jul 06 17:16:10.974822 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:10.974724    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8zc86_15b30428-4c5a-4e9d-b012-1c93eb5301e3/limitador/0.log"
Jul 06 17:16:11.082301 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:11.082264    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-rsm9v_f3af711d-91a3-4b08-a5ba-9df27a2a832b/manager/0.log"
Jul 06 17:16:13.384638 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.384584    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4dpw_d2d9c283-27a3-4219-910e-b96cb2db46ac/node-exporter/0.log"
Jul 06 17:16:13.407053 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.407019    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4dpw_d2d9c283-27a3-4219-910e-b96cb2db46ac/kube-rbac-proxy/0.log"
Jul 06 17:16:13.430557 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.430524    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4dpw_d2d9c283-27a3-4219-910e-b96cb2db46ac/init-textfile/0.log"
Jul 06 17:16:13.461835 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.461799    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9dqrp_1d8d9e03-0752-4ffb-8aee-87fd50804904/kube-rbac-proxy-main/0.log"
Jul 06 17:16:13.486736 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.486707    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9dqrp_1d8d9e03-0752-4ffb-8aee-87fd50804904/kube-rbac-proxy-self/0.log"
Jul 06 17:16:13.511165 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.511077    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-9dqrp_1d8d9e03-0752-4ffb-8aee-87fd50804904/openshift-state-metrics/0.log"
Jul 06 17:16:13.563808 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.563777    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/prometheus/0.log"
Jul 06 17:16:13.587004 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.586969    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/config-reloader/0.log"
Jul 06 17:16:13.610044 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.610017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/thanos-sidecar/0.log"
Jul 06 17:16:13.633214 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.633172    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/kube-rbac-proxy-web/0.log"
Jul 06 17:16:13.658938 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.658904    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/kube-rbac-proxy/0.log"
Jul 06 17:16:13.682334 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.682309    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/kube-rbac-proxy-thanos/0.log"
Jul 06 17:16:13.712085 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.712060    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fe6b7e61-e0a5-41fd-8f32-89481c5f09a5/init-config-reloader/0.log"
Jul 06 17:16:13.746453 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.746376    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7tp9c_f420ce37-4782-4f5b-9d74-992b140c8970/prometheus-operator/0.log"
Jul 06 17:16:13.766886 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:13.766793    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7tp9c_f420ce37-4782-4f5b-9d74-992b140c8970/kube-rbac-proxy/0.log"
Jul 06 17:16:15.335743 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.335708    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-6db2t_d21d8b9a-b99c-4428-a14d-1347b7cc1bb9/networking-console-plugin/0.log"
Jul 06 17:16:15.661699 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.661597    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"]
Jul 06 17:16:15.662012 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.661999    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy"
Jul 06 17:16:15.662059 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662013    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy"
Jul 06 17:16:15.662059 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662028    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44d08bd-be71-4ae1-9ebe-3fa190691027" containerName="main"
Jul 06 17:16:15.662059 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662033    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44d08bd-be71-4ae1-9ebe-3fa190691027" containerName="main"
Jul 06 17:16:15.662059 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662044    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy"
Jul 06 17:16:15.662059 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662050    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy"
Jul 06 17:16:15.662215 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662112    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdc97b47-303d-4e27-bc15-e3758e653539" containerName="istio-proxy"
Jul 06 17:16:15.662215 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662120    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy"
Jul 06 17:16:15.662215 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662129    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ef8aa7-e610-472c-8005-2b3868393317" containerName="istio-proxy"
Jul 06 17:16:15.662215 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.662138    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44d08bd-be71-4ae1-9ebe-3fa190691027" containerName="main"
Jul 06 17:16:15.667246 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.667218    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.669275 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.669246    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rtpd\"/\"kube-root-ca.crt\""
Jul 06 17:16:15.669453 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.669337    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rtpd\"/\"openshift-service-ca.crt\""
Jul 06 17:16:15.670451 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.670427    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8rtpd\"/\"default-dockercfg-52s7j\""
Jul 06 17:16:15.672441 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.672414    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"]
Jul 06 17:16:15.774912 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.774876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-lib-modules\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.775132 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.775034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-proc\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.775132 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.775090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-sys\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.775132 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.775114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-podres\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.775268 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.775140    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ssg\" (UniqueName: \"kubernetes.io/projected/3261b58e-168e-48c7-87bf-c5b58feb462f-kube-api-access-52ssg\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876252 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-podres\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876252 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ssg\" (UniqueName: \"kubernetes.io/projected/3261b58e-168e-48c7-87bf-c5b58feb462f-kube-api-access-52ssg\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876496 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-lib-modules\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876496 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876388    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-podres\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876496 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-proc\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876496 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-proc\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876496 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-sys\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876757 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876501    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-lib-modules\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.876757 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.876535    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3261b58e-168e-48c7-87bf-c5b58feb462f-sys\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.883725 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.883699    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ssg\" (UniqueName: \"kubernetes.io/projected/3261b58e-168e-48c7-87bf-c5b58feb462f-kube-api-access-52ssg\") pod \"perf-node-gather-daemonset-gpcrm\" (UID: \"3261b58e-168e-48c7-87bf-c5b58feb462f\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.979783 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.979666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:15.998045 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:15.998016    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/1.log"
Jul 06 17:16:16.010734 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:16.010687    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-pswbw_982547b7-cb65-4cba-bfe0-225a473bb273/console-operator/2.log"
Jul 06 17:16:16.119641 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:16.119594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"]
Jul 06 17:16:16.122191 ip-10-0-138-170 kubenswrapper[2582]: W0706 17:16:16.122164    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3261b58e_168e_48c7_87bf_c5b58feb462f.slice/crio-884ff2acf1c8b086b1626f1adbb7ceab3d1d24e554fc2b2cbe92364ad32e116e WatchSource:0}: Error finding container 884ff2acf1c8b086b1626f1adbb7ceab3d1d24e554fc2b2cbe92364ad32e116e: Status 404 returned error can't find the container with id 884ff2acf1c8b086b1626f1adbb7ceab3d1d24e554fc2b2cbe92364ad32e116e
Jul 06 17:16:16.295909 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:16.295874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm" event={"ID":"3261b58e-168e-48c7-87bf-c5b58feb462f","Type":"ContainerStarted","Data":"51d5728bd7af29d1c6149ff0aa26bf248d6e5070143bb5c69f6130a1a6747644"}
Jul 06 17:16:16.296092 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:16.295926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm" event={"ID":"3261b58e-168e-48c7-87bf-c5b58feb462f","Type":"ContainerStarted","Data":"884ff2acf1c8b086b1626f1adbb7ceab3d1d24e554fc2b2cbe92364ad32e116e"}
Jul 06 17:16:16.296092 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:16.295951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:16.309774 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:16.309718    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm" podStartSLOduration=1.309701643 podStartE2EDuration="1.309701643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:16:16.309243353 +0000 UTC m=+2886.176644581" watchObservedRunningTime="2026-07-06 17:16:16.309701643 +0000 UTC m=+2886.177102871"
Jul 06 17:16:18.318536 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:18.318504    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2znm5_1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50/dns/0.log"
Jul 06 17:16:18.341393 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:18.341356    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2znm5_1aab3e82-b50f-4c10-b7ad-6a7d2cd50d50/kube-rbac-proxy/0.log"
Jul 06 17:16:18.440709 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:18.440677    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lqx25_2906d07c-60b9-4de3-8cce-3173f346c94f/dns-node-resolver/0.log"
Jul 06 17:16:19.036866 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:19.036835    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4nzpq_bf7e3b12-04e7-4c1a-84a4-b6ac1e9654e7/node-ca/0.log"
Jul 06 17:16:20.052998 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:20.052963    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l29kk_24ab8814-3323-449e-8ead-a354c5f93703/istio-proxy/0.log"
Jul 06 17:16:20.345390 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:20.345277    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/0.log"
Jul 06 17:16:20.400994 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:20.400962    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/1.log"
Jul 06 17:16:21.213020 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:21.212990    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5s6lf_cc9aa07f-dbe6-4e3e-856b-10567463e5ad/serve-healthcheck-canary/0.log"
Jul 06 17:16:21.757991 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:21.757947    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rkgdw_8b2ac55e-485e-4031-94a1-be5d25af4507/insights-operator/0.log"
Jul 06 17:16:21.758650 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:21.758623    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rkgdw_8b2ac55e-485e-4031-94a1-be5d25af4507/insights-operator/1.log"
Jul 06 17:16:21.856359 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:21.856334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6gpp_37d6d521-e827-460e-83aa-deee904f2e7a/kube-rbac-proxy/0.log"
Jul 06 17:16:21.879365 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:21.879334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6gpp_37d6d521-e827-460e-83aa-deee904f2e7a/exporter/0.log"
Jul 06 17:16:21.902150 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:21.902121    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6gpp_37d6d521-e827-460e-83aa-deee904f2e7a/extractor/0.log"
Jul 06 17:16:22.310867 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:22.310841    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-gpcrm"
Jul 06 17:16:24.075011 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:24.074981    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-v7fr7_eef37e1f-b694-4263-8c1e-917f583cbb43/manager/0.log"
Jul 06 17:16:24.320234 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:24.320202    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dhrz2_55c490b0-739f-4688-8c35-e9d09eada6e6/manager/0.log"
Jul 06 17:16:24.622547 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:24.622516    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pflnn_77c99348-d9f3-4fc6-b06f-db701aa287cb/server/0.log"
Jul 06 17:16:24.730691 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:24.730666    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-px5gf_5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe/manager/0.log"
Jul 06 17:16:24.752217 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:24.752190    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-px5gf_5b6ac1f2-61fe-4d05-aaea-fb5fdcc94cfe/copy-manifests/0.log"
Jul 06 17:16:26.114964 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:26.114934    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l29kk_24ab8814-3323-449e-8ead-a354c5f93703/istio-proxy/0.log"
Jul 06 17:16:26.376173 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:26.376142    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/0.log"
Jul 06 17:16:26.431070 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:26.431036    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/1.log"
Jul 06 17:16:26.489010 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:26.488973    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5db866ddc8-2pwbw_e1020f17-1d96-491d-8046-0de818b1e7c3/manager/0.log"
Jul 06 17:16:27.791579 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:27.791551    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l29kk_24ab8814-3323-449e-8ead-a354c5f93703/istio-proxy/0.log"
Jul 06 17:16:28.061275 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:28.061179    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/0.log"
Jul 06 17:16:28.115769 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:28.115724    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-kmg7k_7fd9831b-a3f0-48a3-8d3b-8ce82dec1f3c/istio-proxy/1.log"
Jul 06 17:16:33.416254 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.416222    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/kube-multus-additional-cni-plugins/0.log"
Jul 06 17:16:33.439741 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.439702    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/egress-router-binary-copy/0.log"
Jul 06 17:16:33.462681 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.462647    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/cni-plugins/0.log"
Jul 06 17:16:33.485890 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.485865    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/bond-cni-plugin/0.log"
Jul 06 17:16:33.511495 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.511456    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/routeoverride-cni/0.log"
Jul 06 17:16:33.537179 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.537147    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/whereabouts-cni-bincopy/0.log"
Jul 06 17:16:33.562539 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.562505    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnj85_764949f2-d89e-4ca3-83ec-78ac11ee46d9/whereabouts-cni/0.log"
Jul 06 17:16:33.615491 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.615438    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-czqqh_7da341e5-f1cb-40da-8f65-54daad7ac3de/kube-multus/0.log"
Jul 06 17:16:33.726893 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.726794    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gw5p5_655bddab-22f1-4791-978f-17fa819303af/network-metrics-daemon/0.log"
Jul 06 17:16:33.746917 ip-10-0-138-170 kubenswrapper[2582]: I0706 17:16:33.746882    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gw5p5_655bddab-22f1-4791-978f-17fa819303af/kube-rbac-proxy/0.log"