Jul 02 19:03:09.377936 ip-10-0-130-68 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 19:03:09.377947 ip-10-0-130-68 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 19:03:09.377956 ip-10-0-130-68 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 19:03:09.378259 ip-10-0-130-68 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 19:03:19.380476 ip-10-0-130-68 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 19:03:19.380494 ip-10-0-130-68 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 03fc4b3bcc5d42adab6171f7cd307a13 --
Jul 02 19:05:16.810475 ip-10-0-130-68 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:05:17.143789 ip-10-0-130-68 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:05:17.143789 ip-10-0-130-68 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:05:17.143789 ip-10-0-130-68 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:05:17.143789 ip-10-0-130-68 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:05:17.143789 ip-10-0-130-68 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:05:17.145496 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.145413    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:05:17.149511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149497    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:05:17.149511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149512    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149516    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149519    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149523    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149526    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149529    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149531    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149534    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149537    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149540    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149544    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149546    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149549    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149551    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149554    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149557    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149559    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149562    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149565    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149568    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:05:17.149573 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149570    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149573    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149575    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149578    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149581    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149584    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149586    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149589    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149592    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149594    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149597    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149600    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149603    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149605    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149608    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149610    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149612    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149615    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149617    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149620    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:05:17.150045 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149622    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149624    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149627    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149629    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149632    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149634    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149636    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149639    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149641    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149644    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149646    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149650    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149652    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149654    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149658    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149662    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149665    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149668    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149671    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:05:17.150511 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149674    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149676    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149679    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149682    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149685    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149688    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149691    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149693    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149696    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149699    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149701    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149704    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149707    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149709    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149712    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149714    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149717    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149719    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149722    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:05:17.150997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149724    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149728    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149732    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149735    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149737    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149740    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149742    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149745    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149749    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149751    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149754    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149756    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149759    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149761    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149763    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149766    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149797    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149802    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149806    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:05:17.151443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.149809    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150478    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150486    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150489    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150492    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150494    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150497    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150500    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150503    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150506    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150508    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150511    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150513    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150516    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150518    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150521    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150524    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150526    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150529    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:05:17.151940 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150532    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150534    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150537    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150540    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150542    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150545    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150547    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150550    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150552    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150554    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150557    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150560    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150562    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150564    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150567    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150571    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150575    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150577    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150580    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150582    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:05:17.152443 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150586    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150588    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150591    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150593    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150596    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150598    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150600    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150603    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150605    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150607    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150631    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150635    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150638    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150641    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150645    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150648    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150650    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150653    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150656    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150659    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:05:17.152951 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150662    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150664    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150667    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150670    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150672    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150674    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150677    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150679    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150682    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150684    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150687    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150689    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150692    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150695    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150698    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150700    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150703    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150705    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150708    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:05:17.153456 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150710    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150713    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150717    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150721    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150724    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150727    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150730    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150733    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150736    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150739    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150742    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150745    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150748    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150751    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150753    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150756    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150758    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150761    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150764    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150766    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:05:17.153899 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150769    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.150772    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151194    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151201    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151205    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151208    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151211    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151214    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151217    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151220    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151222    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151225    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151228    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151230    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151237    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151241    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151244    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151247    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151250    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151253    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:05:17.154365 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151256    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151259    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151262    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151265    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151268    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151271    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151274    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151277    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151279    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151282    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151284    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151288    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151290    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151293    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151295    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151298    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151301    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151303    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151306    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:05:17.154835 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151310    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151320    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151322    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151325    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151327    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151330    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151332    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151336    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151339    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151342    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151345    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151347    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151350    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151353    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151355    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151358    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151360    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151363    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151365    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151368    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:05:17.155285 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151370    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151373    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151375    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151378    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151380    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151384    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151386    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151388    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151391    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151393    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151396    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151398    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151401    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151404    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151407    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151409    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151412    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151414    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151416    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151420    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:05:17.155730 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151423    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151425    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151428    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151430    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151433    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151435    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151438    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151441    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151443    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151446    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151449    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151451    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151454    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151456    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151459    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151461    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151465    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151469    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151472    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:05:17.156258 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151474    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151477    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.151480    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151553    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151568    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151578    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151584    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151595    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151599    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151607    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151611    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151614    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151619    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151622    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151625    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151628    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151635    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151638    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151641    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151643    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151646    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151650    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151653    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:05:17.156697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151656    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151659    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151662    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151666    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151669    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151671    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151674    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151677    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151680    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151683    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151686    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151689    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151693    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151695    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151698    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151701    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151704    2563 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151707    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151712    2563 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151715    2563 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151717    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151720    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151723    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151727    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:05:17.157243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151730    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151734    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151737    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151740    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151743    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151746    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151748    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151751    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151754    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151756    2563 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151760    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151763    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151766    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151769    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151772    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151775    2563 flags.go:64] FLAG: --help="false"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151778    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-68.ec2.internal"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151781    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151784    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151787    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151790    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151793    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151796    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:05:17.157819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151799    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151801    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151804    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151808    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151811    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151814    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151817    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151819    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151823    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151838    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151843    2563 flags.go:64] FLAG: --lock-file=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151845    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151848    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151851    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151857    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151859    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151862    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151865    2563 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151867    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151870    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151873    2563 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151876    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151880    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151883    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151886    2563 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:05:17.158394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151889    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151892    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151895    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151898    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151901    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151904    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151907    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151913    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151916    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151919    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151922    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151926    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151931    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151934    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151937    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151940    2563 flags.go:64] FLAG: --port="10250"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151943    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151947    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f37c6bc364c176b9"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151950    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151953    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151956    2563 flags.go:64] FLAG: --register-node="true"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151959    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151962    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151964    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:05:17.158960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151967    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151970    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151973    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151976    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151979    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151981    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151984    2563 flags.go:64] FLAG: --runonce="false"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151987    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151990    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151992    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151995    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.151997    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152000    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152003    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152006    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152008    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152011    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152014    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152016    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152019    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152022    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152025    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152033    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152035    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152038    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:05:17.159554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152043    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152046    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152048    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152051    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152054    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152057    2563 flags.go:64] FLAG: --v="2"
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152060    2563 flags.go:64] FLAG: --version="false"
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152064    2563 flags.go:64] FLAG: --vmodule=""
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152067    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.152070    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152216    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152221    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152224    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152227    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152230    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152233    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152235    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152238    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152241    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152243    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152246    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152248    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:05:17.160179 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152251    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152255    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152258    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152261    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152264    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152267    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152270    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152274    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152277    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152281    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152285    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152287    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152290    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152293    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152295    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152298    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152300    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152303    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152306    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:05:17.160705 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152308    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152311    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152314    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152316    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152319    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152321    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152324    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152327    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152329    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152332    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152334    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152337    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152340    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152342    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152345    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152348    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152351    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152353    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152356    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152359    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:05:17.161222 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152364    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152366    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152369    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152372    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152375    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152377    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152380    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152383    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152385    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152388    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152390    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152393    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152395    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152398    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152400    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152403    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152405    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152407    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152410    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152412    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:05:17.161727 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152415    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152418    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152420    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152423    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152425    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152428    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152430    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152433    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152435    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152438    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152441    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152446    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152450    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152453    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152456    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152460    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152462    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152465    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152469    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:05:17.162226 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152472    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152475    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152478    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152480    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152483    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152486    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152488    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152491    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.152494    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.153124    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.159646    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.159660    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.159697    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.159703    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159761    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:05:17.162786 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159766    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159769    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159773    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159776    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159779    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159781    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159784    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159787    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159790    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159792    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159795    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159798    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159801    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159804    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159807    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159809    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159812    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159815    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159817    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159820    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:05:17.163149 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159823    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159825    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159828    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159831    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159833    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159836    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159838    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159841    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159845    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159847    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159850    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159853    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159855    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159858    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159860    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159863    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159866    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159868    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159871    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159874    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:05:17.163611 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159876    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159879    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159881    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159884    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159887    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159889    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159892    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159894    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159897    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159900    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159902    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159905    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159908    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159911    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159913    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159916    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159918    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159920    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159923    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159927    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:05:17.164106 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159931    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159934    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159937    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159940    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159943    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159945    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159948    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159951    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159954    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159957    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159959    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159962    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159965    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159967    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159970    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159972    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159975    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159978    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159980    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159983    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:05:17.164631 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159986    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159988    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159991    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159993    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159996    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.159999    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160001    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160004    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160007    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160011    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160014    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160017    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160019    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160022    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160024    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160027    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160030    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:05:17.165094 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160033    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.160038    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160165    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160171    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160174    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160176    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160179    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160182    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160185    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160187    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160190    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160193    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160195    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160199    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160202    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:05:17.165583 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160204    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160207    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160209    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160212    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160215    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160217    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160220    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160222    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160225    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160228    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160230    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160233    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160235    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160238    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160240    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160243    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160245    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160247    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160250    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160253    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:05:17.165942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160255    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160258    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160260    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160263    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160265    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160267    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160270    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160272    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160275    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160277    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160280    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160283    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160285    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160288    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160290    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160293    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160295    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160298    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160300    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160303    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:05:17.166407 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160305    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160309    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160312    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160315    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160318    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160321    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160323    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160326    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160328    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160331    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160333    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160336    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160339    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160341    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160344    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160346    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160348    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160351    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160353    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:05:17.166863 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160356    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160358    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160361    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160363    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160366    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160369    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160371    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160374    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160376    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160379    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160381    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160384    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160386    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160389    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160391    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160393    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160397    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160400    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160403    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:05:17.167304 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160406    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160409    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160412    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160414    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160417    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160420    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160424    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:17.160427    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.160431    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.160519    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.164550    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.166032    2563 server.go:1019] "Starting client certificate rotation"
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.166512    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:05:17.167761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.166575    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:05:17.168310 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.168297    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:05:17.171079 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.171056    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:05:17.181114 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.181094    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:05:17.184801 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.184786    2563 log.go:25] "Validated CRI v1 image API"
Jul 02 19:05:17.186255 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.186242    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:05:17.188366 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.188348    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b6b80826-c2a2-45a3-abab-582f2868778b:/dev/nvme0n1p4 c51ee586-8656-4701-a5d6-deeaf797694e:/dev/nvme0n1p3]
Jul 02 19:05:17.188423 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.188366    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:05:17.192529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.192422    2563 manager.go:216] Machine: {Timestamp:2026-07-02 19:05:17.19189529 +0000 UTC m=+0.283086752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097854 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec267251b7494961498e5e0905f2f855 SystemUUID:ec267251-b749-4961-498e-5e0905f2f855 BootID:03fc4b3b-cc5d-42ad-ab61-71f7cd307a13 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:d0:bb:bb:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:d0:bb:bb:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:79:e1:ed:18:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:05:17.192529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.192517    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:05:17.192658 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.192607    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:05:17.195249 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.195224    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:05:17.195383 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.195252    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:05:17.195992 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.195983    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:05:17.196024 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.195995    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:05:17.196024 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.196001    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:05:17.197259 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.197248    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:05:17.197316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.197298    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:05:17.198704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.198693    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:05:17.202725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202713    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:05:17.202835 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202826    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:05:17.202866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202854    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:05:17.202866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202863    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:05:17.202914 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202877    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:05:17.202914 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202886    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:05:17.202914 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.202894    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:05:17.203239 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.203228    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:05:17.203275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.203249    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:05:17.205102 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.205086    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:05:17.207099 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.207087    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:05:17.207151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.207115    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:05:17.208747 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208736    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:05:17.208789 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208753    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:05:17.208789 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208759    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:05:17.208789 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208771    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:05:17.208789 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208780    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:05:17.208789 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208786    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:05:17.208911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208794    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:05:17.208911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208799    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:05:17.208911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208805    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:05:17.208911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208811    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:05:17.208911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208822    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:05:17.208911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.208827    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:05:17.209487 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.209478    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:05:17.209487 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.209488    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:05:17.214994 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.214976    2563 server.go:1268] "Started kubelet"
Jul 02 19:05:17.215082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.215038    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:05:17.215172 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.215112    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:05:17.215225 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.215194    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:05:17.215768 ip-10-0-130-68 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:05:17.216961 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.216945    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:05:17.217282 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.217262    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:05:17.218199 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.218171    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:05:17.218312 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.218219    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:05:17.218312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.218247    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:05:17.220220 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.220202    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:05:17.223256 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223240    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:05:17.223328 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223257    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:05:17.223373 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.223328    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:17.223818 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223798    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:05:17.223818 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223798    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:05:17.223818 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223820    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:05:17.223983 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223877    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:05:17.223983 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.223887    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:05:17.224085 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224065    2563 factory.go:55] Registering systemd factory
Jul 02 19:05:17.224085 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224086    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:05:17.224293 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.223334    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-68.ec2.internal.18be8e70b553c464  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-68.ec2.internal,UID:ip-10-0-130-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-68.ec2.internal,},FirstTimestamp:2026-07-02 19:05:17.214942308 +0000 UTC m=+0.306133768,LastTimestamp:2026-07-02 19:05:17.214942308 +0000 UTC m=+0.306133768,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-68.ec2.internal,}"
Jul 02 19:05:17.224358 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224344    2563 factory.go:153] Registering CRI-O factory
Jul 02 19:05:17.224358 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224358    2563 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:05:17.224451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224406    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:05:17.224451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224436    2563 factory.go:103] Registering Raw factory
Jul 02 19:05:17.224451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224450    2563 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:05:17.224829 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.224813    2563 manager.go:349] Starting recovery of all containers
Jul 02 19:05:17.231688 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.231654    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:05:17.233114 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.231751    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:05:17.233221 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.233127    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:05:17.236058 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.236042    2563 manager.go:354] Recovery completed
Jul 02 19:05:17.238511 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.238488    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 02 19:05:17.241472 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.241459    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:17.243085 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243067    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:17.243168 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243095    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:17.243168 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243105    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:17.243720 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243705    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:05:17.243720 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243716    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:17.243854 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243719    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:05:17.243854 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.243769    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:05:17.244496 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.244477    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:17.244554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.244509    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:17.244554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.244525    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:17.245289 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.245198    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-68.ec2.internal.18be8e70b70129a1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-68.ec2.internal,UID:ip-10-0-130-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-68.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-68.ec2.internal,},FirstTimestamp:2026-07-02 19:05:17.243083169 +0000 UTC m=+0.334274629,LastTimestamp:2026-07-02 19:05:17.243083169 +0000 UTC m=+0.334274629,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-68.ec2.internal,}"
Jul 02 19:05:17.245989 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.245977    2563 policy_none.go:49] "None policy: Start"
Jul 02 19:05:17.246034 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.245994    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:05:17.246034 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.246007    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:05:17.248175 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.248162    2563 policy_none.go:47] "Start"
Jul 02 19:05:17.251498 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.251479    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ht8xp"
Jul 02 19:05:17.255036 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.254968    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-68.ec2.internal.18be8e70b7016a32  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-68.ec2.internal,UID:ip-10-0-130-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-68.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-68.ec2.internal,},FirstTimestamp:2026-07-02 19:05:17.243099698 +0000 UTC m=+0.334291158,LastTimestamp:2026-07-02 19:05:17.243099698 +0000 UTC m=+0.334291158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-68.ec2.internal,}"
Jul 02 19:05:17.257495 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.257480    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ht8xp"
Jul 02 19:05:17.283734 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.283629    2563 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:05:17.283822 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.283747    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:05:17.283822 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.283758    2563 server.go:87] "Starting device plugin registration server"
Jul 02 19:05:17.283973 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.283963    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:05:17.284024 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.283974    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:05:17.284087 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.284069    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:05:17.284210 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.284194    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:05:17.284210 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:17.284206    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:05:17.284617 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.284603    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:05:17.284681 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:17.284642    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:18.475610 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.475579    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:18.476447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.476429    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:18.476540 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.476471    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:18.476540 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.476485    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:18.476540 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.476513    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.488464 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.488405    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.488464 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.488425    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-68.ec2.internal\": node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:18.488619 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.488604    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:05:18.488657 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.488640    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:05:18.488698 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.488658    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:05:18.488698 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.488688    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:05:18.493519 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.493501    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:05:18.546903 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.546879    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:18.588810 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.588769    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"]
Jul 02 19:05:18.588878 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.588849    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:18.590492 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.590468    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:18.590568 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.590502    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:18.590568 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.590516    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:18.592928 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.592912    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:18.593023 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.593010    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.593067 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.593037    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:18.594374 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.594353    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:18.594452 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.594385    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:18.594452 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.594396    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:18.594452 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.594353    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:18.594547 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.594454    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:18.594547 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.594466    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:18.596627 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.596613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.596696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.596653    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:05:18.597403 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.597389    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:05:18.597479 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.597415    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:05:18.597479 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.597428    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:05:18.617416 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.617398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc0b3f9b6c39ce24339a07d36ee5583c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal\" (UID: \"dc0b3f9b6c39ce24339a07d36ee5583c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.617486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.617420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc0b3f9b6c39ce24339a07d36ee5583c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal\" (UID: \"dc0b3f9b6c39ce24339a07d36ee5583c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.617486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.617436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0dea7adbf423fab172398bcf6fc984fe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-68.ec2.internal\" (UID: \"0dea7adbf423fab172398bcf6fc984fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.623737 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.623724    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-68.ec2.internal\" not found" node="ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.627965 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.627951    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-68.ec2.internal\" not found" node="ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.647525 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.647505    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:18.718223 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.718186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc0b3f9b6c39ce24339a07d36ee5583c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal\" (UID: \"dc0b3f9b6c39ce24339a07d36ee5583c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.718302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.718231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0dea7adbf423fab172398bcf6fc984fe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-68.ec2.internal\" (UID: \"0dea7adbf423fab172398bcf6fc984fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.718302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.718248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc0b3f9b6c39ce24339a07d36ee5583c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal\" (UID: \"dc0b3f9b6c39ce24339a07d36ee5583c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.718302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.718274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dc0b3f9b6c39ce24339a07d36ee5583c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal\" (UID: \"dc0b3f9b6c39ce24339a07d36ee5583c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.718302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.718275    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc0b3f9b6c39ce24339a07d36ee5583c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal\" (UID: \"dc0b3f9b6c39ce24339a07d36ee5583c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.718302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.718279    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0dea7adbf423fab172398bcf6fc984fe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-68.ec2.internal\" (UID: \"0dea7adbf423fab172398bcf6fc984fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.748310 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.748261    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:18.849045 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.849010    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:18.927492 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.927469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.931290 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:18.931271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:18.949223 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:18.949204    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:19.049660 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.049636    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:19.150212 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.150170    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:19.250630 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.250602    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-68.ec2.internal\" not found"
Jul 02 19:05:19.256762 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.256744    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:05:19.256904 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.256887    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:05:19.272349 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.272335    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:05:19.294442 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.294426    2563 apiserver.go:52] "Watching apiserver"
Jul 02 19:05:19.303131 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.303075    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:05:19.303774 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.303757    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-qwc76","openshift-multus/network-metrics-daemon-szbkd","openshift-network-diagnostics/network-check-target-j5cz5","kube-system/global-pull-secret-syncer-mz5fw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str","openshift-cluster-node-tuning-operator/tuned-mgq5r","openshift-network-operator/iptables-alerter-pt2rr","openshift-ovn-kubernetes/ovnkube-node-qgkkd","kube-system/konnectivity-agent-tl8l9","openshift-dns/node-resolver-77ddp","openshift-image-registry/node-ca-24vp7","openshift-multus/multus-additional-cni-plugins-lv8kl"]
Jul 02 19:05:19.306307 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.306288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.309782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.309764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.309862 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.309831    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:19.309960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.309944    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.310128 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.310104    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t9xkw\""
Jul 02 19:05:19.310838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.310363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:05:19.310838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.310380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.311997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.311981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:19.312077 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.312047    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:19.313250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.313235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:05:19.314146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.314131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.314245 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.314192    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:19.314842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.314813    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:19.314929 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.314827    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:05:19.316298 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.316284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.318525 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.318507    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.318598 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.318568    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:05:19.318664 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.318649    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.318713 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.318664    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.318785 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.318721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pv6g2\""
Jul 02 19:05:19.320355 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320313    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v25b2\""
Jul 02 19:05:19.320575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-system-cni-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.320646 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-kubelet\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.320646 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-multus-certs\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.320741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76w2f\" (UniqueName: \"kubernetes.io/projected/92d6e659-ebad-427c-b889-09a2d07b992f-kube-api-access-76w2f\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.320741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320671    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.320741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320678    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.320741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-socket-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.320741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-cnibin\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.320741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqp7s\" (UniqueName: \"kubernetes.io/projected/e010d783-1ce5-466a-a426-5948fe57db1a-kube-api-access-cqp7s\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-netns\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-cni-multus\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-etc-kubernetes\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-socket-dir-parent\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-conf-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92d6e659-ebad-427c-b889-09a2d07b992f-multus-daemon-config\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.320986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321036    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-registration-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-sys-fs\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-hostroot\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2g9m\" (UniqueName: \"kubernetes.io/projected/1354ecb0-9981-4f7c-bff7-560eab7366d8-kube-api-access-h2g9m\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14c46bc5-e149-424d-980b-b42c710f91de-dbus\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.321315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-k8s-cni-cncf-io\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-cni-bin\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14c46bc5-e149-424d-980b-b42c710f91de-kubelet-config\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-device-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-cni-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-os-release\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92d6e659-ebad-427c-b889-09a2d07b992f-cni-binary-copy\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.321838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.321379    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.323138 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.323122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.323497 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.323471    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:05:19.323615 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.323601    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5twqp\""
Jul 02 19:05:19.324136 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.324119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.324229 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.324156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.325293 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.325278    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.325372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.325357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.326270 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.326254    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:05:19.326546 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.326529    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:05:19.326627 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.326560    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:05:19.326968 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.326953    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.327543 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.327529    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:05:19.327681 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.327663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.330087 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.330688 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5v5dv\""
Jul 02 19:05:19.330791 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330690    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w65xh\""
Jul 02 19:05:19.330791 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330710    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:05:19.330791 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330718    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:05:19.330934 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330811    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:05:19.330934 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330822    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.330934 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.330907    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.331062 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.331050    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rzc27\""
Jul 02 19:05:19.332350 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.332334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.334324 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.334308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:05:19.334418 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.334398    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:05:19.334418 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.334411    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:05:19.334528 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.334513    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zrvzn\""
Jul 02 19:05:19.334722 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.334706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5jlc\""
Jul 02 19:05:19.334849 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.334836    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:05:19.342419 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.342403    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:05:19.346919 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.346905    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal"]
Jul 02 19:05:19.346986 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.346977    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:05:19.347035 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.347026    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"
Jul 02 19:05:19.351742 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.351700    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:00:18 +0000 UTC" deadline="2028-03-14 02:54:41.689670308 +0000 UTC"
Jul 02 19:05:19.351828 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.351742    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14887h49m22.337931697s"
Jul 02 19:05:19.359961 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.359948    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal"]
Jul 02 19:05:19.360279 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.360267    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:05:19.382905 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.382886    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7v4tg"
Jul 02 19:05:19.396046 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.396025    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7v4tg"
Jul 02 19:05:19.415624 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.415605    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:05:19.421628 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-netns\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.421723 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-etc-kubernetes\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.421723 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.421723 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-var-lib-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.421723 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421746    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-etc-kubernetes\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-netns\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-os-release\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.421800    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-var-lib-kubelet\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-socket-dir-parent\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.421866 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.421864    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:19.921844533 +0000 UTC m=+1.921981318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-conf-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421936    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-socket-dir-parent\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f409d175-8465-4bba-b626-06b7a84e18c7-ovn-node-metrics-cert\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f92f2f0-97a6-4883-8b49-39e920502784-tmp\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.421993    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-conf-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2g9m\" (UniqueName: \"kubernetes.io/projected/1354ecb0-9981-4f7c-bff7-560eab7366d8-kube-api-access-h2g9m\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25c836c0-6750-4015-a46d-f9da2e851165-tmp-dir\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-systemd\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-kubernetes\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14c46bc5-e149-424d-980b-b42c710f91de-dbus\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-k8s-cni-cncf-io\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-cni-netd\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.422227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422229    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-host\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422252    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-k8s-cni-cncf-io\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-cnibin\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422362    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14c46bc5-e149-424d-980b-b42c710f91de-dbus\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422382    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92d6e659-ebad-427c-b889-09a2d07b992f-cni-binary-copy\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/181211ff-ca60-4154-8d2b-561d770c9e97-konnectivity-ca\") pod \"konnectivity-agent-tl8l9\" (UID: \"181211ff-ca60-4154-8d2b-561d770c9e97\") " pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-sys\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-system-cni-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-kubelet\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422546    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-multus-certs\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxqsb\" (UniqueName: \"kubernetes.io/projected/bb7c4902-8e21-43f4-a320-e02423c0309c-kube-api-access-mxqsb\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422608    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-system-cni-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-kubelet\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422643    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-run-multus-certs\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb7xs\" (UniqueName: \"kubernetes.io/projected/25c836c0-6750-4015-a46d-f9da2e851165-kube-api-access-rb7xs\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-systemd-units\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.422782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-run-netns\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f92f2f0-97a6-4883-8b49-39e920502784-etc-tuned\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-log-socket\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/181211ff-ca60-4154-8d2b-561d770c9e97-agent-certs\") pod \"konnectivity-agent-tl8l9\" (UID: \"181211ff-ca60-4154-8d2b-561d770c9e97\") " pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-system-cni-dir\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqp7s\" (UniqueName: \"kubernetes.io/projected/e010d783-1ce5-466a-a426-5948fe57db1a-kube-api-access-cqp7s\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-cni-multus\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.422959    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92d6e659-ebad-427c-b889-09a2d07b992f-cni-binary-copy\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25c836c0-6750-4015-a46d-f9da2e851165-hosts-file\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-cni-multus\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423033    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-slash\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-ovn\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-ovnkube-config\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-modprobe-d\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92d6e659-ebad-427c-b889-09a2d07b992f-multus-daemon-config\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.423842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysctl-conf\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcshp\" (UniqueName: \"kubernetes.io/projected/4f92f2f0-97a6-4883-8b49-39e920502784-kube-api-access-qcshp\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423395    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-registration-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-sys-fs\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423464    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-hostroot\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-systemd\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423498    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-registration-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423510    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423519    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-sys-fs\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423533    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-hostroot\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb7c4902-8e21-43f4-a320-e02423c0309c-host-slash\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-etc-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.423596    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:19.424553 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-env-overrides\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.423660    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:05:19.923642305 +0000 UTC m=+1.923779080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423679    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92d6e659-ebad-427c-b889-09a2d07b992f-multus-daemon-config\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-serviceca\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-run\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-lib-modules\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-cni-bin\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423838    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423892    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-host-var-lib-cni-bin\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-ovnkube-script-lib\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mszhp\" (UniqueName: \"kubernetes.io/projected/f409d175-8465-4bba-b626-06b7a84e18c7-kube-api-access-mszhp\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6st2\" (UniqueName: \"kubernetes.io/projected/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-kube-api-access-s6st2\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.423985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14c46bc5-e149-424d-980b-b42c710f91de-kubelet-config\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.425078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-device-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424050    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14c46bc5-e149-424d-980b-b42c710f91de-kubelet-config\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-cni-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-os-release\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424092    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-device-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-node-log\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424134    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysconfig\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424142    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-os-release\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424151    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-multus-cni-dir\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76w2f\" (UniqueName: \"kubernetes.io/projected/92d6e659-ebad-427c-b889-09a2d07b992f-kube-api-access-76w2f\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-kubelet\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-cni-bin\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-cni-binary-copy\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxlbz\" (UniqueName: \"kubernetes.io/projected/083bc306-b06d-41ff-b88a-060fb75d780c-kube-api-access-qxlbz\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysctl-d\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-host\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-socket-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.425534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-cnibin\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.426012 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb7c4902-8e21-43f4-a320-e02423c0309c-iptables-alerter-script\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.426012 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e010d783-1ce5-466a-a426-5948fe57db1a-socket-dir\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.426012 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.424461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92d6e659-ebad-427c-b889-09a2d07b992f-cnibin\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.440052 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.440033    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:19.440224 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.440055    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:19.440224 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.440069    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:19.440224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.440087    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:05:19.440224 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.440121    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:19.940106779 +0000 UTC m=+1.940243571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:19.443529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.443457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76w2f\" (UniqueName: \"kubernetes.io/projected/92d6e659-ebad-427c-b889-09a2d07b992f-kube-api-access-76w2f\") pod \"multus-qwc76\" (UID: \"92d6e659-ebad-427c-b889-09a2d07b992f\") " pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.443529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.443468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqp7s\" (UniqueName: \"kubernetes.io/projected/e010d783-1ce5-466a-a426-5948fe57db1a-kube-api-access-cqp7s\") pod \"aws-ebs-csi-driver-node-46str\" (UID: \"e010d783-1ce5-466a-a426-5948fe57db1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.444041 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.444009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2g9m\" (UniqueName: \"kubernetes.io/projected/1354ecb0-9981-4f7c-bff7-560eab7366d8-kube-api-access-h2g9m\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.524752 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-systemd\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb7c4902-8e21-43f4-a320-e02423c0309c-host-slash\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-etc-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-env-overrides\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524810    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-serviceca\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-run\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb7c4902-8e21-43f4-a320-e02423c0309c-host-slash\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-lib-modules\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-systemd\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.524873 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524859    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-etc-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524910    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-run\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524935    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-ovnkube-script-lib\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-lib-modules\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.524981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mszhp\" (UniqueName: \"kubernetes.io/projected/f409d175-8465-4bba-b626-06b7a84e18c7-kube-api-access-mszhp\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6st2\" (UniqueName: \"kubernetes.io/projected/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-kube-api-access-s6st2\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-node-log\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysconfig\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-kubelet\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-cni-bin\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-cni-binary-copy\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525239    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-node-log\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525270    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-env-overrides\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525253    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysconfig\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525298    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-serviceca\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.525316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525311    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-cni-bin\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxlbz\" (UniqueName: \"kubernetes.io/projected/083bc306-b06d-41ff-b88a-060fb75d780c-kube-api-access-qxlbz\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525340    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-kubelet\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysctl-d\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-host\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525380    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb7c4902-8e21-43f4-a320-e02423c0309c-iptables-alerter-script\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-var-lib-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525431    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-host\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-os-release\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-var-lib-openvswitch\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525489    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-ovnkube-script-lib\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525498    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysctl-d\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-var-lib-kubelet\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f409d175-8465-4bba-b626-06b7a84e18c7-ovn-node-metrics-cert\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525560    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-var-lib-kubelet\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525561    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-os-release\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f92f2f0-97a6-4883-8b49-39e920502784-tmp\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525592    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-run-ovn-kubernetes\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25c836c0-6750-4015-a46d-f9da2e851165-tmp-dir\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-systemd\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-kubernetes\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-cni-netd\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-host\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525699    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-systemd\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-cnibin\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525716    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-kubernetes\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525730    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-cni-netd\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525758    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-cnibin\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525768    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-host\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/181211ff-ca60-4154-8d2b-561d770c9e97-konnectivity-ca\") pod \"konnectivity-agent-tl8l9\" (UID: \"181211ff-ca60-4154-8d2b-561d770c9e97\") " pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-sys\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxqsb\" (UniqueName: \"kubernetes.io/projected/bb7c4902-8e21-43f4-a320-e02423c0309c-kube-api-access-mxqsb\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.526997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb7xs\" (UniqueName: \"kubernetes.io/projected/25c836c0-6750-4015-a46d-f9da2e851165-kube-api-access-rb7xs\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.525935    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-cni-binary-copy\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526004    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/25c836c0-6750-4015-a46d-f9da2e851165-tmp-dir\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526075    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-sys\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526125    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb7c4902-8e21-43f4-a320-e02423c0309c-iptables-alerter-script\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-systemd-units\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526178    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-run-netns\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f92f2f0-97a6-4883-8b49-39e920502784-etc-tuned\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-log-socket\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526255    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-systemd-units\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/181211ff-ca60-4154-8d2b-561d770c9e97-agent-certs\") pod \"konnectivity-agent-tl8l9\" (UID: \"181211ff-ca60-4154-8d2b-561d770c9e97\") " pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-run-netns\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-system-cni-dir\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25c836c0-6750-4015-a46d-f9da2e851165-hosts-file\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-slash\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-ovn\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.527647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-ovnkube-config\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526396    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/083bc306-b06d-41ff-b88a-060fb75d780c-system-cni-dir\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-modprobe-d\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526463    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-log-socket\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-run-ovn\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysctl-conf\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcshp\" (UniqueName: \"kubernetes.io/projected/4f92f2f0-97a6-4883-8b49-39e920502784-kube-api-access-qcshp\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/181211ff-ca60-4154-8d2b-561d770c9e97-konnectivity-ca\") pod \"konnectivity-agent-tl8l9\" (UID: \"181211ff-ca60-4154-8d2b-561d770c9e97\") " pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-sysctl-conf\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526761    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f92f2f0-97a6-4883-8b49-39e920502784-etc-modprobe-d\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526790    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-slash\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526836    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f409d175-8465-4bba-b626-06b7a84e18c7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.526999    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/25c836c0-6750-4015-a46d-f9da2e851165-hosts-file\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.527093    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f409d175-8465-4bba-b626-06b7a84e18c7-ovnkube-config\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.527263    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/083bc306-b06d-41ff-b88a-060fb75d780c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.528402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.528131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f409d175-8465-4bba-b626-06b7a84e18c7-ovn-node-metrics-cert\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.528881 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.528185    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f92f2f0-97a6-4883-8b49-39e920502784-tmp\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528881 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.528395    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f92f2f0-97a6-4883-8b49-39e920502784-etc-tuned\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.528881 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.528607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/181211ff-ca60-4154-8d2b-561d770c9e97-agent-certs\") pod \"konnectivity-agent-tl8l9\" (UID: \"181211ff-ca60-4154-8d2b-561d770c9e97\") " pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.535034 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.535010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mszhp\" (UniqueName: \"kubernetes.io/projected/f409d175-8465-4bba-b626-06b7a84e18c7-kube-api-access-mszhp\") pod \"ovnkube-node-qgkkd\" (UID: \"f409d175-8465-4bba-b626-06b7a84e18c7\") " pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.535483 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.535462    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6st2\" (UniqueName: \"kubernetes.io/projected/56a93b7a-7b85-4591-92d4-37fcfb0c8cd4-kube-api-access-s6st2\") pod \"node-ca-24vp7\" (UID: \"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4\") " pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.535748 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.535730    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcshp\" (UniqueName: \"kubernetes.io/projected/4f92f2f0-97a6-4883-8b49-39e920502784-kube-api-access-qcshp\") pod \"tuned-mgq5r\" (UID: \"4f92f2f0-97a6-4883-8b49-39e920502784\") " pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.536255 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.536232    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxlbz\" (UniqueName: \"kubernetes.io/projected/083bc306-b06d-41ff-b88a-060fb75d780c-kube-api-access-qxlbz\") pod \"multus-additional-cni-plugins-lv8kl\" (UID: \"083bc306-b06d-41ff-b88a-060fb75d780c\") " pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.536372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.536276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb7xs\" (UniqueName: \"kubernetes.io/projected/25c836c0-6750-4015-a46d-f9da2e851165-kube-api-access-rb7xs\") pod \"node-resolver-77ddp\" (UID: \"25c836c0-6750-4015-a46d-f9da2e851165\") " pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.536466 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.536450    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxqsb\" (UniqueName: \"kubernetes.io/projected/bb7c4902-8e21-43f4-a320-e02423c0309c-kube-api-access-mxqsb\") pod \"iptables-alerter-pt2rr\" (UID: \"bb7c4902-8e21-43f4-a320-e02423c0309c\") " pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.558894 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.558838    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dea7adbf423fab172398bcf6fc984fe.slice/crio-94daed0c95ca73bdd5e3856c2da854280979a99040170a89c8c6b2613be030c0 WatchSource:0}: Error finding container 94daed0c95ca73bdd5e3856c2da854280979a99040170a89c8c6b2613be030c0: Status 404 returned error can't find the container with id 94daed0c95ca73bdd5e3856c2da854280979a99040170a89c8c6b2613be030c0
Jul 02 19:05:19.559946 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.559929    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0b3f9b6c39ce24339a07d36ee5583c.slice/crio-d13c4dbd26f2d2b54f0fd302a8a727150d3efc1b7b36db1362a11d5dac2a90d8 WatchSource:0}: Error finding container d13c4dbd26f2d2b54f0fd302a8a727150d3efc1b7b36db1362a11d5dac2a90d8: Status 404 returned error can't find the container with id d13c4dbd26f2d2b54f0fd302a8a727150d3efc1b7b36db1362a11d5dac2a90d8
Jul 02 19:05:19.563680 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.563666    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:05:19.576923 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.576907    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:05:19.640076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.640055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qwc76"
Jul 02 19:05:19.649308 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.649288    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d6e659_ebad_427c_b889_09a2d07b992f.slice/crio-092a8bf3b8ba0a2ca9e57b0f3848c7bad1a81ae37f945c3031375214607bd263 WatchSource:0}: Error finding container 092a8bf3b8ba0a2ca9e57b0f3848c7bad1a81ae37f945c3031375214607bd263: Status 404 returned error can't find the container with id 092a8bf3b8ba0a2ca9e57b0f3848c7bad1a81ae37f945c3031375214607bd263
Jul 02 19:05:19.653290 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.653272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str"
Jul 02 19:05:19.661191 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.661169    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode010d783_1ce5_466a_a426_5948fe57db1a.slice/crio-92d1731207569b2dbe66caed4f1dbe55ea2287d779fb3e6d4b73b58fb9db88a7 WatchSource:0}: Error finding container 92d1731207569b2dbe66caed4f1dbe55ea2287d779fb3e6d4b73b58fb9db88a7: Status 404 returned error can't find the container with id 92d1731207569b2dbe66caed4f1dbe55ea2287d779fb3e6d4b73b58fb9db88a7
Jul 02 19:05:19.669481 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.669466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mgq5r"
Jul 02 19:05:19.676679 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.676656    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f92f2f0_97a6_4883_8b49_39e920502784.slice/crio-912c3c5077817df0f0a6c0d0cf0d2c00f9f340a3c335a70df4a19447c30b5410 WatchSource:0}: Error finding container 912c3c5077817df0f0a6c0d0cf0d2c00f9f340a3c335a70df4a19447c30b5410: Status 404 returned error can't find the container with id 912c3c5077817df0f0a6c0d0cf0d2c00f9f340a3c335a70df4a19447c30b5410
Jul 02 19:05:19.685975 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.685961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pt2rr"
Jul 02 19:05:19.694746 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.694727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7c4902_8e21_43f4_a320_e02423c0309c.slice/crio-0e6ae68deaa291029bade46b7ebf25dae550a01299b86b7af3ebcb2b9727f01a WatchSource:0}: Error finding container 0e6ae68deaa291029bade46b7ebf25dae550a01299b86b7af3ebcb2b9727f01a: Status 404 returned error can't find the container with id 0e6ae68deaa291029bade46b7ebf25dae550a01299b86b7af3ebcb2b9727f01a
Jul 02 19:05:19.702608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.702594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:19.709950 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.709932    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf409d175_8465_4bba_b626_06b7a84e18c7.slice/crio-76835ddb5d0a8ec9df7d2b8cae33ef3b43157bbcba0105b8a5517f092ac5d2f8 WatchSource:0}: Error finding container 76835ddb5d0a8ec9df7d2b8cae33ef3b43157bbcba0105b8a5517f092ac5d2f8: Status 404 returned error can't find the container with id 76835ddb5d0a8ec9df7d2b8cae33ef3b43157bbcba0105b8a5517f092ac5d2f8
Jul 02 19:05:19.720232 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.720213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:19.727622 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.727601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181211ff_ca60_4154_8d2b_561d770c9e97.slice/crio-f9332321340c959fe990f41fad0de34ed8760924bff62a9b2a26970e0995d70a WatchSource:0}: Error finding container f9332321340c959fe990f41fad0de34ed8760924bff62a9b2a26970e0995d70a: Status 404 returned error can't find the container with id f9332321340c959fe990f41fad0de34ed8760924bff62a9b2a26970e0995d70a
Jul 02 19:05:19.740045 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.740028    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-24vp7"
Jul 02 19:05:19.747148 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.747131    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a93b7a_7b85_4591_92d4_37fcfb0c8cd4.slice/crio-384d30bc2ade4963327b98c503e9d437a595022299b44537c6b683b8026616dc WatchSource:0}: Error finding container 384d30bc2ade4963327b98c503e9d437a595022299b44537c6b683b8026616dc: Status 404 returned error can't find the container with id 384d30bc2ade4963327b98c503e9d437a595022299b44537c6b683b8026616dc
Jul 02 19:05:19.762586 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.762551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lv8kl"
Jul 02 19:05:19.768376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.768357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-77ddp"
Jul 02 19:05:19.769968 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.769949    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083bc306_b06d_41ff_b88a_060fb75d780c.slice/crio-a0c382dbd185af0183d5b4736d51410fd4c3dba162aa55b588e0f3d40dbe1269 WatchSource:0}: Error finding container a0c382dbd185af0183d5b4736d51410fd4c3dba162aa55b588e0f3d40dbe1269: Status 404 returned error can't find the container with id a0c382dbd185af0183d5b4736d51410fd4c3dba162aa55b588e0f3d40dbe1269
Jul 02 19:05:19.777561 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:19.777540    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c836c0_6750_4015_a46d_f9da2e851165.slice/crio-37c50c5cafdd2b5d1f3e9210c913a808de50d3e894ad54a8f2c34ca814c517a6 WatchSource:0}: Error finding container 37c50c5cafdd2b5d1f3e9210c913a808de50d3e894ad54a8f2c34ca814c517a6: Status 404 returned error can't find the container with id 37c50c5cafdd2b5d1f3e9210c913a808de50d3e894ad54a8f2c34ca814c517a6
Jul 02 19:05:19.787667 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.787651    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:05:19.929124 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.929054    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:19.929124 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:19.929098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:19.929285 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.929222    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:19.929285 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.929271    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:20.929257711 +0000 UTC m=+2.929394483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:19.929392 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.929222    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:19.929392 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:19.929347    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:05:20.929334618 +0000 UTC m=+2.929471395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:20.029903 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.029867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:20.030078 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.030006    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:20.030078 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.030023    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:20.030078 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.030031    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:20.030267 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.030091    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:21.030070846 +0000 UTC m=+3.030207633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:20.383372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.383341    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:05:20.399796 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.399666    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:00:19 +0000 UTC" deadline="2027-12-10 10:21:02.804808962 +0000 UTC"
Jul 02 19:05:20.399796 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.399724    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12615h15m42.40508879s"
Jul 02 19:05:20.490751 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.489918    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:20.490751 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.490044    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:20.490751 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.490618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:20.490751 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.490711    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:20.519856 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.519783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"76835ddb5d0a8ec9df7d2b8cae33ef3b43157bbcba0105b8a5517f092ac5d2f8"}
Jul 02 19:05:20.539600 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.539555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pt2rr" event={"ID":"bb7c4902-8e21-43f4-a320-e02423c0309c","Type":"ContainerStarted","Data":"0e6ae68deaa291029bade46b7ebf25dae550a01299b86b7af3ebcb2b9727f01a"}
Jul 02 19:05:20.563704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.563672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mgq5r" event={"ID":"4f92f2f0-97a6-4883-8b49-39e920502784","Type":"ContainerStarted","Data":"912c3c5077817df0f0a6c0d0cf0d2c00f9f340a3c335a70df4a19447c30b5410"}
Jul 02 19:05:20.591742 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.591678    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qwc76" event={"ID":"92d6e659-ebad-427c-b889-09a2d07b992f","Type":"ContainerStarted","Data":"092a8bf3b8ba0a2ca9e57b0f3848c7bad1a81ae37f945c3031375214607bd263"}
Jul 02 19:05:20.611437 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.611407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal" event={"ID":"dc0b3f9b6c39ce24339a07d36ee5583c","Type":"ContainerStarted","Data":"d13c4dbd26f2d2b54f0fd302a8a727150d3efc1b7b36db1362a11d5dac2a90d8"}
Jul 02 19:05:20.629400 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.629372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-77ddp" event={"ID":"25c836c0-6750-4015-a46d-f9da2e851165","Type":"ContainerStarted","Data":"37c50c5cafdd2b5d1f3e9210c913a808de50d3e894ad54a8f2c34ca814c517a6"}
Jul 02 19:05:20.650666 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.650528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerStarted","Data":"a0c382dbd185af0183d5b4736d51410fd4c3dba162aa55b588e0f3d40dbe1269"}
Jul 02 19:05:20.669544 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.669513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-24vp7" event={"ID":"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4","Type":"ContainerStarted","Data":"384d30bc2ade4963327b98c503e9d437a595022299b44537c6b683b8026616dc"}
Jul 02 19:05:20.674290 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.674220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tl8l9" event={"ID":"181211ff-ca60-4154-8d2b-561d770c9e97","Type":"ContainerStarted","Data":"f9332321340c959fe990f41fad0de34ed8760924bff62a9b2a26970e0995d70a"}
Jul 02 19:05:20.678539 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.678458    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str" event={"ID":"e010d783-1ce5-466a-a426-5948fe57db1a","Type":"ContainerStarted","Data":"92d1731207569b2dbe66caed4f1dbe55ea2287d779fb3e6d4b73b58fb9db88a7"}
Jul 02 19:05:20.687456 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.687428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal" event={"ID":"0dea7adbf423fab172398bcf6fc984fe","Type":"ContainerStarted","Data":"94daed0c95ca73bdd5e3856c2da854280979a99040170a89c8c6b2613be030c0"}
Jul 02 19:05:20.938662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.938581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:20.938662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:20.938646    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:20.938885 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.938799    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:20.938885 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.938860    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:22.938840713 +0000 UTC m=+4.938977500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:20.939268 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.939249    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:20.939361 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:20.939306    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:05:22.939291077 +0000 UTC m=+4.939427856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:21.039779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:21.038982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:21.039779 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:21.039146    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:21.039779 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:21.039165    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:21.039779 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:21.039184    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:21.039779 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:21.039260    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:23.039241338 +0000 UTC m=+5.039378114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:21.400906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:21.400867    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:00:19 +0000 UTC" deadline="2027-12-27 13:51:04.685104932 +0000 UTC"
Jul 02 19:05:21.400906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:21.400903    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13026h45m43.284205889s"
Jul 02 19:05:21.489951 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:21.489255    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:21.489951 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:21.489392    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:22.491938 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:22.489300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:22.491938 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:22.489422    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:22.491938 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:22.491811    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:22.491938 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:22.491909    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:22.955952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:22.955917    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:22.956143 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:22.955977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:22.956143 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:22.956118    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:22.956286 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:22.956178    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:26.956159461 +0000 UTC m=+8.956296251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:22.956751 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:22.956620    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:22.956751 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:22.956673    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:05:26.956657749 +0000 UTC m=+8.956794528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:23.057171 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:23.057135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:23.057504 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:23.057372    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:23.057504 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:23.057402    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:23.057504 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:23.057418    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:23.057504 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:23.057484    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:27.057464594 +0000 UTC m=+9.057601369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:23.489398 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:23.489365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:23.489550 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:23.489482    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:24.489906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:24.489866    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:24.489906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:24.489904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:24.490438 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:24.490011    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:24.490499 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:24.490462    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:25.489016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:25.488904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:25.489215 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:25.489038    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:26.490980 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:26.490298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:26.490980 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:26.490455    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:26.490980 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:26.490828    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:26.490980 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:26.490945    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:26.988840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:26.988671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:26.988840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:26.988754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:26.989097 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:26.988916    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:26.989097 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:26.988982    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:34.988960173 +0000 UTC m=+16.989096958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:26.989254 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:26.989225    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:26.989314 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:26.989294    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:05:34.989275301 +0000 UTC m=+16.989412085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:27.089274 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:27.089235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:27.089432 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:27.089384    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:27.089432 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:27.089406    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:27.089432 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:27.089418    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:27.089584 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:27.089477    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:35.089459487 +0000 UTC m=+17.089596264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:27.489666 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:27.489167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:27.489666 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:27.489322    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:28.493090 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:28.491058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:28.493090 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:28.491191    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:28.493090 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:28.492022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:28.493090 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:28.492128    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:29.489721 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:29.489688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:29.489888 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:29.489827    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:30.489305 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:30.489265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:30.489740 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:30.489265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:30.489740 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:30.489400    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:30.489740 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:30.489511    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:31.489679 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:31.489630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:31.490099 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:31.489776    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:32.489717 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:32.489685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:32.489717 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:32.489685    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:32.490211 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:32.489818    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:32.490211 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:32.489959    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:33.489697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:33.489664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:33.489841 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:33.489768    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:34.489592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:34.489560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:34.489592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:34.489596    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:34.489815 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:34.489684    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:34.489855 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:34.489823    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:35.046673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:35.046591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:35.046673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:35.046647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:35.046897 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.046752    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:35.046897 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.046765    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:35.046897 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.046828    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:05:51.046807514 +0000 UTC m=+33.046944287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:35.046897 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.046852    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:51.046840085 +0000 UTC m=+33.046976887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:35.147306 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:35.147264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:35.147485 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.147400    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:35.147485 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.147425    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:35.147485 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.147438    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:35.147629 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.147504    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:51.147483141 +0000 UTC m=+33.147619913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:35.489848 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:35.489766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:35.490290 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:35.489916    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:36.489293 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:36.489250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:36.489480 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:36.489251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:36.489480 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:36.489378    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:36.489597 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:36.489483    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:37.489459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:37.489424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:37.489891 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:37.489562    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:38.489812 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:38.489609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:38.490287 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:38.489682    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:38.490287 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:38.489896    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:38.490287 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:38.489978    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:39.488867 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:39.488846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:39.488968 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:39.488948    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:39.727028 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:39.726938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qwc76" event={"ID":"92d6e659-ebad-427c-b889-09a2d07b992f","Type":"ContainerStarted","Data":"db235efe6f4d5b12e1f7bdb188c451ce4200dfc956a3769c45ef548b14659107"}
Jul 02 19:05:39.730985 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:39.730959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal" event={"ID":"0dea7adbf423fab172398bcf6fc984fe","Type":"ContainerStarted","Data":"69e0f68dcd1689a64fea48b17705c96cd6be028b1bdff0393ea3cef6bd0fbb32"}
Jul 02 19:05:39.732302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:39.732283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mgq5r" event={"ID":"4f92f2f0-97a6-4883-8b49-39e920502784","Type":"ContainerStarted","Data":"cfc57606f0ee20ea7d83adaabb0dc4a2b5df1667c412a543da8124270ff165d0"}
Jul 02 19:05:39.744138 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:39.744098    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qwc76" podStartSLOduration=1.97652997 podStartE2EDuration="21.744086747s" totalImagesPullingTime="19.767556777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:39.743763107 +0000 UTC m=+21.743899902" watchObservedRunningTime="2026-07-02 19:05:39.744086747 +0000 UTC m=+21.744223540"
Jul 02 19:05:39.759219 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:39.759165    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-68.ec2.internal" podStartSLOduration=20.759146837 podStartE2EDuration="20.759146837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:39.759074174 +0000 UTC m=+21.759210968" watchObservedRunningTime="2026-07-02 19:05:39.759146837 +0000 UTC m=+21.759283630"
Jul 02 19:05:40.489415 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.489268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:40.489575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.489337    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:40.489641 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:40.489582    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:40.489736 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:40.489710    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:40.735496 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.735459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-77ddp" event={"ID":"25c836c0-6750-4015-a46d-f9da2e851165","Type":"ContainerStarted","Data":"54283f74fac9e2038c862d36c171d1cbe9a9cb758eefa0855d043648f120388d"}
Jul 02 19:05:40.739451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.739426    2563 generic.go:356] "Generic (PLEG): container finished" podID="083bc306-b06d-41ff-b88a-060fb75d780c" containerID="9e54e6ed4b19a2ca7cba8a4bf3b318fa2b19ac841d7f4174981318201bdae05b" exitCode=0
Jul 02 19:05:40.739583 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.739504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerDied","Data":"9e54e6ed4b19a2ca7cba8a4bf3b318fa2b19ac841d7f4174981318201bdae05b"}
Jul 02 19:05:40.741171 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.741147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-24vp7" event={"ID":"56a93b7a-7b85-4591-92d4-37fcfb0c8cd4","Type":"ContainerStarted","Data":"a17cd5cebbf80f2086879bef818e8f2bb930f5b84fd0bbe8507c5a1566d255be"}
Jul 02 19:05:40.742714 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.742687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tl8l9" event={"ID":"181211ff-ca60-4154-8d2b-561d770c9e97","Type":"ContainerStarted","Data":"d501a0b48c5cc8210d430ea7fa14f62466fb8f831d10324ed5f62f38d2b8e6e0"}
Jul 02 19:05:40.744112 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.744092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str" event={"ID":"e010d783-1ce5-466a-a426-5948fe57db1a","Type":"ContainerStarted","Data":"29c118de57e3048085f21e792bfb6390cdee31c65430331b6ce337e4c9154082"}
Jul 02 19:05:40.747103 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747086    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:05:40.747448 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747421    2563 generic.go:356] "Generic (PLEG): container finished" podID="f409d175-8465-4bba-b626-06b7a84e18c7" containerID="f6c18e935a8fd2a9240c244b38edb9e44199adf39bc7ee0d54a17fef79732fc6" exitCode=1
Jul 02 19:05:40.747552 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747485    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"8d82e34c0042f1a5dd1b55b52d0295290578faa3d01f8aae3be496544aa7f9bb"}
Jul 02 19:05:40.747552 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"39699058e5d006b00edb961f2bfe2631128cf2b9433140483a3ff802ced0c76e"}
Jul 02 19:05:40.747665 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"bcd4eacee0d5f961e87826224e782d298d572592f3af02ed31416c8b3852d374"}
Jul 02 19:05:40.747665 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"3af42862811979ef84ed461b9a33256d4742f712ac62679dc4308bd23239f044"}
Jul 02 19:05:40.747773 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerDied","Data":"f6c18e935a8fd2a9240c244b38edb9e44199adf39bc7ee0d54a17fef79732fc6"}
Jul 02 19:05:40.747773 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.747709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"6a2ecbcf8cf949973dcf499d39e5a5a35ea357117238f28e5f74c8018e87460e"}
Jul 02 19:05:40.748923 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.748903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pt2rr" event={"ID":"bb7c4902-8e21-43f4-a320-e02423c0309c","Type":"ContainerStarted","Data":"f67e6e96d1abdc4281c7e8cb72aaa33113b1e8699fe2ec91518ed39bc5540b43"}
Jul 02 19:05:40.750239 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.750179    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mgq5r" podStartSLOduration=3.253943305 podStartE2EDuration="22.750165888s" totalImagesPullingTime="19.496222583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:39.776276365 +0000 UTC m=+21.776413160" watchObservedRunningTime="2026-07-02 19:05:40.750165888 +0000 UTC m=+22.750302681"
Jul 02 19:05:40.750503 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.750482    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc0b3f9b6c39ce24339a07d36ee5583c" containerID="a5d9e63aad78038d099ffd08b5059f59c3ae7bfdedc86396654a061f72d85073" exitCode=0
Jul 02 19:05:40.750587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.750511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal" event={"ID":"dc0b3f9b6c39ce24339a07d36ee5583c","Type":"ContainerDied","Data":"a5d9e63aad78038d099ffd08b5059f59c3ae7bfdedc86396654a061f72d85073"}
Jul 02 19:05:40.750587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.750544    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-77ddp" podStartSLOduration=2.356345413 podStartE2EDuration="21.750535135s" totalImagesPullingTime="19.394189722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:40.750118205 +0000 UTC m=+22.750255001" watchObservedRunningTime="2026-07-02 19:05:40.750535135 +0000 UTC m=+22.750671930"
Jul 02 19:05:40.781337 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.781110    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pt2rr" podStartSLOduration=3.304891497 podStartE2EDuration="22.781098153s" totalImagesPullingTime="19.476206656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:40.764750721 +0000 UTC m=+22.764887527" watchObservedRunningTime="2026-07-02 19:05:40.781098153 +0000 UTC m=+22.781234946"
Jul 02 19:05:40.781554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.781519    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tl8l9" podStartSLOduration=7.929780044 podStartE2EDuration="22.781512076s" totalImagesPullingTime="14.851732032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:40.780819085 +0000 UTC m=+22.780955880" watchObservedRunningTime="2026-07-02 19:05:40.781512076 +0000 UTC m=+22.781648870"
Jul 02 19:05:40.795145 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.795105    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-24vp7" podStartSLOduration=3.371027053 podStartE2EDuration="22.795094439s" totalImagesPullingTime="19.424067386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:40.794584351 +0000 UTC m=+22.794721146" watchObservedRunningTime="2026-07-02 19:05:40.795094439 +0000 UTC m=+22.795231231"
Jul 02 19:05:40.973456 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.973430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:40.973912 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:40.973896    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:41.489179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.489103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:41.489422 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:41.489270    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:41.751291 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.751268    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:05:41.754106 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.754084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str" event={"ID":"e010d783-1ce5-466a-a426-5948fe57db1a","Type":"ContainerStarted","Data":"9963582f1502bda5adeaa7c16fe65f7bdb3e3877af997c6b0350e5af7db48ee7"}
Jul 02 19:05:41.755559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.755516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal" event={"ID":"dc0b3f9b6c39ce24339a07d36ee5583c","Type":"ContainerStarted","Data":"96b198961fa3f358b278f7d7d2a0d57af4b8a9930987663f875d08f107bf94ef"}
Jul 02 19:05:41.755824 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.755758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:41.756319 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.756304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tl8l9"
Jul 02 19:05:41.769707 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:41.769668    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-68.ec2.internal" podStartSLOduration=22.769657189 podStartE2EDuration="22.769657189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:41.769592378 +0000 UTC m=+23.769729172" watchObservedRunningTime="2026-07-02 19:05:41.769657189 +0000 UTC m=+23.769793979"
Jul 02 19:05:42.386459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:42.386342    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:05:41.751288249Z","UUID":"b5a38db5-b7ee-440c-818f-e44369df03cd","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:05:42.388142 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:42.388108    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:05:42.388306 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:42.388154    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:05:42.489154 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:42.489125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:42.489314 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:42.489246    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:42.489382 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:42.489343    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:42.489465 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:42.489447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:43.489275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:43.489245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:43.489720 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:43.489367    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:43.763745 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:43.763681    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:05:43.764091 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:43.764064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"5a11b1ae7005c57ca1989d61f8638b66f9bf9a33c4b00cc691f82b57e2766678"}
Jul 02 19:05:43.765791 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:43.765766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str" event={"ID":"e010d783-1ce5-466a-a426-5948fe57db1a","Type":"ContainerStarted","Data":"5a127b5b23aa4b7eaa62518756826d2191212bcf3af2745b25196953148fce93"}
Jul 02 19:05:43.786555 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:43.786515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-46str" podStartSLOduration=4.03347158 podStartE2EDuration="25.786503764s" totalImagesPullingTime="21.753032184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:43.786141168 +0000 UTC m=+25.786277961" watchObservedRunningTime="2026-07-02 19:05:43.786503764 +0000 UTC m=+25.786640557"
Jul 02 19:05:44.488907 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:44.488879    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:44.489090 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:44.488886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:44.489090 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:44.488985    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:44.489090 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:44.489070    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:45.490023 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.489815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:45.490677 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:45.490112    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:45.773257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.773227    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:05:45.773674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.773635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"2d72ff77b95cf07ace0eb54b94fd7e97f89bfcc34502e0a21f2748ecd8a2dd25"}
Jul 02 19:05:45.773990 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.773965    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:45.774120 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.774052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:45.774183 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.774160    2563 scope.go:117] "RemoveContainer" containerID="f6c18e935a8fd2a9240c244b38edb9e44199adf39bc7ee0d54a17fef79732fc6"
Jul 02 19:05:45.790386 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:45.790366    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:46.489296 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.489269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:46.489424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:46.489379    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:46.489477 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.489431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:46.489561 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:46.489540    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:46.778330 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.778102    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerStarted","Data":"ae48dec65872d9860386b108ab09a860f31a34ff3ea0c3310ee139b4d9b55782"}
Jul 02 19:05:46.781853 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.781834    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:05:46.782220 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.782178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" event={"ID":"f409d175-8465-4bba-b626-06b7a84e18c7","Type":"ContainerStarted","Data":"2fc78fcfd1ed7ad02393244338f4d381f7416274116063b8405aa3dc0a174538"}
Jul 02 19:05:46.782550 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.782531    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:46.796584 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.796564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:05:46.825362 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.825250    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd" podStartSLOduration=8.5161258 podStartE2EDuration="28.825234101s" totalImagesPullingTime="20.309108301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:46.824751556 +0000 UTC m=+28.824888363" watchObservedRunningTime="2026-07-02 19:05:46.825234101 +0000 UTC m=+28.825370891"
Jul 02 19:05:46.952151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.952123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mz5fw"]
Jul 02 19:05:46.952377 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.952256    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:46.952377 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:46.952365    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:46.955657 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.955633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-szbkd"]
Jul 02 19:05:46.955748 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.955734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:46.955843 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:46.955825    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:46.956222 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.956173    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5cz5"]
Jul 02 19:05:46.956321 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:46.956274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:46.956402 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:46.956385    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:47.786099 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:47.786067    2563 generic.go:356] "Generic (PLEG): container finished" podID="083bc306-b06d-41ff-b88a-060fb75d780c" containerID="ae48dec65872d9860386b108ab09a860f31a34ff3ea0c3310ee139b4d9b55782" exitCode=0
Jul 02 19:05:47.786459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:47.786141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerDied","Data":"ae48dec65872d9860386b108ab09a860f31a34ff3ea0c3310ee139b4d9b55782"}
Jul 02 19:05:48.490581 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:48.490545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:48.490753 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:48.490594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:48.490753 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:48.490680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:48.490753 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:48.490677    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:48.490856 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:48.490754    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:48.490856 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:48.490840    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:48.790896 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:48.790868    2563 generic.go:356] "Generic (PLEG): container finished" podID="083bc306-b06d-41ff-b88a-060fb75d780c" containerID="2e92f1f61e573fb08a65ae0ff5fd614ca92614f394d6f7b01b619565a9fa9c9d" exitCode=0
Jul 02 19:05:48.791336 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:48.790946    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerDied","Data":"2e92f1f61e573fb08a65ae0ff5fd614ca92614f394d6f7b01b619565a9fa9c9d"}
Jul 02 19:05:50.489535 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:50.489508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:50.489535 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:50.489533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:50.489912 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:50.489508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:50.489912 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:50.489625    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:50.489912 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:50.489669    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:50.489912 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:50.489741    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:50.797635 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:50.797602    2563 generic.go:356] "Generic (PLEG): container finished" podID="083bc306-b06d-41ff-b88a-060fb75d780c" containerID="df68507eb4ce6c4d82219620974aed3aa50f0ec907c17ad1d904d5505d186f2c" exitCode=0
Jul 02 19:05:50.797792 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:50.797664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerDied","Data":"df68507eb4ce6c4d82219620974aed3aa50f0ec907c17ad1d904d5505d186f2c"}
Jul 02 19:05:51.070317 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:51.070235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:51.070317 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:51.070302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:51.070500 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.070374    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:51.070500 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.070393    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:51.070500 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.070443    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs podName:1354ecb0-9981-4f7c-bff7-560eab7366d8 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:23.070423454 +0000 UTC m=+65.070560227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs") pod "network-metrics-daemon-szbkd" (UID: "1354ecb0-9981-4f7c-bff7-560eab7366d8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:05:51.070500 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.070458    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret podName:14c46bc5-e149-424d-980b-b42c710f91de nodeName:}" failed. No retries permitted until 2026-07-02 19:06:23.070451643 +0000 UTC m=+65.070588414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret") pod "global-pull-secret-syncer-mz5fw" (UID: "14c46bc5-e149-424d-980b-b42c710f91de") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:05:51.170714 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:51.170689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:51.170813 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.170801    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:05:51.170844 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.170819    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:05:51.170844 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.170827    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7kqv2 for pod openshift-network-diagnostics/network-check-target-j5cz5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:51.170912 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:51.170865    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2 podName:57c531ef-1875-43f5-89dd-3824fe3e7d49 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:23.170853764 +0000 UTC m=+65.170990535 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kqv2" (UniqueName: "kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2") pod "network-check-target-j5cz5" (UID: "57c531ef-1875-43f5-89dd-3824fe3e7d49") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:05:52.489948 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:52.489910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:52.490397 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:52.489910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:52.490397 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:52.490157    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j5cz5" podUID="57c531ef-1875-43f5-89dd-3824fe3e7d49"
Jul 02 19:05:52.490397 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:52.490039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:52.490397 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:52.490037    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mz5fw" podUID="14c46bc5-e149-424d-980b-b42c710f91de"
Jul 02 19:05:52.490397 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:52.490286    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-szbkd" podUID="1354ecb0-9981-4f7c-bff7-560eab7366d8"
Jul 02 19:05:53.302843 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.302671    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-68.ec2.internal" event="NodeReady"
Jul 02 19:05:53.303056 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.302959    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:05:53.340318 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.340284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dff8579d6-866sx"]
Jul 02 19:05:53.343390 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.343368    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.345974 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.345915    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-68mj4\""
Jul 02 19:05:53.345974 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.345949    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 19:05:53.346302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.346281    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 19:05:53.346466 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.346435    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 19:05:53.350801 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.350774    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"]
Jul 02 19:05:53.355920 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.355902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 19:05:53.356495 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.356478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.358420 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.358396    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 19:05:53.358525 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.358473    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x25qj\""
Jul 02 19:05:53.358909 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.358791    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.358909 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.358808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 19:05:53.358909 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.358835    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.362052 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.362032    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dff8579d6-866sx"]
Jul 02 19:05:53.367163 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.366804    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"]
Jul 02 19:05:53.370101 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.370075    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"]
Jul 02 19:05:53.370236 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.370207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.373899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.373397    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-r4bzw"]
Jul 02 19:05:53.373899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.373476    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.373899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.373518    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 02 19:05:53.373899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.373606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.373899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.373525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.373899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.373711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 02 19:05:53.374315 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.374099    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m6n62\""
Jul 02 19:05:53.376785 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.376766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 19:05:53.376895 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.376879    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.377015 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.376996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"]
Jul 02 19:05:53.377166 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.377104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.377356 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.377311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.377356 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.377341    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bkbd2\""
Jul 02 19:05:53.377841 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.377824    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 19:05:53.380587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.380572    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cd975f88c-dch65"]
Jul 02 19:05:53.380699 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.380684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:53.381190 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.381173    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 19:05:53.381510 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.381492    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.381719 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.381704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.384523 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.384503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-97g5n\""
Jul 02 19:05:53.384613 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.384550    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 19:05:53.385474 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.385455    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-29rmk"]
Jul 02 19:05:53.385588 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.385573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.387159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.386690    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n2m97\""
Jul 02 19:05:53.387392 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.387376    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 19:05:53.388078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.388061    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 19:05:53.388757 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.388734    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"]
Jul 02 19:05:53.389673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.388912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.389673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.389267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.389673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.389458    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.390851 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.390534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 19:05:53.390851 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.390695    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.390851 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.390725    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 19:05:53.391038 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.390927    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 19:05:53.391680 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.391237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 19:05:53.391680 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.391293    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-72rrm\""
Jul 02 19:05:53.391680 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.391443    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.392564 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.392542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5p2g6"]
Jul 02 19:05:53.392869 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.392853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"
Jul 02 19:05:53.396033 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.396015    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.398039 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.397290    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 02 19:05:53.398183 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.397770    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 02 19:05:53.398261 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.397912    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.398975 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.398958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7xhfj\""
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.401554    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hpdh6\""
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.401712    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"]
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.401743    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"]
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.401781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"]
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.401815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"]
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.401852    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"]
Jul 02 19:05:53.402224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.402031    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.402999 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.402830    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.403344 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.403272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.405978 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.405960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:05:53.406709 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.406685    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crw8l\""
Jul 02 19:05:53.406954 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.406921    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-29rmk"]
Jul 02 19:05:53.407097 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.407085    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-r4bzw"]
Jul 02 19:05:53.407217 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.407038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:53.407586 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.407394    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6dhcq"]
Jul 02 19:05:53.407849 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.407428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:05:53.408970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.408951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 02 19:05:53.410947 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.410928    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"]
Jul 02 19:05:53.411119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.411055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.412701 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.412682    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-drbcx\""
Jul 02 19:05:53.412813 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.412733    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 19:05:53.412936 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.412921    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 19:05:53.415663 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.415645    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:05:53.416262 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.416246    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.416512 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.416477    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h97jw\""
Jul 02 19:05:53.417276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.417258    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.418014 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.417677    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5p2g6"]
Jul 02 19:05:53.418014 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.417717    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"]
Jul 02 19:05:53.418014 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.417738    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"]
Jul 02 19:05:53.418014 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.417747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"
Jul 02 19:05:53.418014 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.417754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cd975f88c-dch65"]
Jul 02 19:05:53.418547 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.418018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6dhcq"]
Jul 02 19:05:53.419881 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.419867    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gflf8\""
Jul 02 19:05:53.420114 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.420101    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:05:53.420524 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.420508    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:05:53.425561 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.425490    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"]
Jul 02 19:05:53.486318 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.486444 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ff4e99e-b459-44db-898e-bdd58f23e263-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:53.486444 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.486444 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-registry-certificates\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.486611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh94x\" (UniqueName: \"kubernetes.io/projected/a3d70706-f8d8-4cd0-8482-4014f647862d-kube-api-access-vh94x\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.486611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a29c843-42c5-467e-8901-09eaea74437f-tmp-dir\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.486611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6s46\" (UniqueName: \"kubernetes.io/projected/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-kube-api-access-d6s46\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:53.486611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-installation-pull-secrets\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.486611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486570    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ce04143-9907-44b1-bffa-8f9ca68d7cce-snapshots\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.486611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-default-certificate\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/541000a1-2cf4-413b-a73c-d55b557852d1-serving-cert\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j98k\" (UniqueName: \"kubernetes.io/projected/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-kube-api-access-6j98k\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq6dh\" (UniqueName: \"kubernetes.io/projected/32e8db40-57d9-422f-9921-efd69a90c2a6-kube-api-access-rq6dh\") pod \"ingress-canary-6dhcq\" (UID: \"32e8db40-57d9-422f-9921-efd69a90c2a6\") " pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssqns\" (UniqueName: \"kubernetes.io/projected/541000a1-2cf4-413b-a73c-d55b557852d1-kube-api-access-ssqns\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d60c55d-f32c-4989-82e5-578078c05efb-ca-trust-extracted\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32e8db40-57d9-422f-9921-efd69a90c2a6-cert\") pod \"ingress-canary-6dhcq\" (UID: \"32e8db40-57d9-422f-9921-efd69a90c2a6\") " pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.486892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jllpw\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-kube-api-access-jllpw\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frdtd\" (UniqueName: \"kubernetes.io/projected/540972c4-6ade-4a03-aef0-6b7370716ce6-kube-api-access-frdtd\") pod \"volume-data-source-validator-5d456fdbcd-cvxdf\" (UID: \"540972c4-6ade-4a03-aef0-6b7370716ce6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.486935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-stats-auth\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fjvf\" (UniqueName: \"kubernetes.io/projected/2ce04143-9907-44b1-bffa-8f9ca68d7cce-kube-api-access-8fjvf\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487050    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce04143-9907-44b1-bffa-8f9ca68d7cce-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3d70706-f8d8-4cd0-8482-4014f647862d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487130    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/541000a1-2cf4-413b-a73c-d55b557852d1-config\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/541000a1-2cf4-413b-a73c-d55b557852d1-trusted-ca\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw87d\" (UniqueName: \"kubernetes.io/projected/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-kube-api-access-vw87d\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-trusted-ca\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.487340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-bound-sa-token\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce04143-9907-44b1-bffa-8f9ca68d7cce-tmp\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a29c843-42c5-467e-8901-09eaea74437f-config-volume\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce04143-9907-44b1-bffa-8f9ca68d7cce-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-image-registry-private-configuration\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qmts\" (UniqueName: \"kubernetes.io/projected/7a29c843-42c5-467e-8901-09eaea74437f-kube-api-access-8qmts\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487471    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-config\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf8x4\" (UniqueName: \"kubernetes.io/projected/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-kube-api-access-bf8x4\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d70706-f8d8-4cd0-8482-4014f647862d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.488043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.487526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ce04143-9907-44b1-bffa-8f9ca68d7cce-serving-cert\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.588029 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.587935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3d70706-f8d8-4cd0-8482-4014f647862d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.588029 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.587977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpg6v\" (UniqueName: \"kubernetes.io/projected/ec73d99a-faf2-4896-8536-5da76e39496c-kube-api-access-rpg6v\") pod \"network-check-source-989f8b8dc-xpftx\" (UID: \"ec73d99a-faf2-4896-8536-5da76e39496c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"
Jul 02 19:05:53.588029 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588004    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/541000a1-2cf4-413b-a73c-d55b557852d1-config\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.588029 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/541000a1-2cf4-413b-a73c-d55b557852d1-trusted-ca\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw87d\" (UniqueName: \"kubernetes.io/projected/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-kube-api-access-vw87d\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-trusted-ca\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588250    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588301    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588328    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls podName:ef6b4cd2-464e-49f8-9aa9-3450d64e0762 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.088308852 +0000 UTC m=+36.088445643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nrd2c" (UID: "ef6b4cd2-464e-49f8-9aa9-3450d64e0762") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588402    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588443    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls podName:6a7e1acf-7b8f-4f44-8f6a-427e77b86935 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.088425594 +0000 UTC m=+36.088562385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p229j" (UID: "6a7e1acf-7b8f-4f44-8f6a-427e77b86935") : secret "samples-operator-tls" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588495    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588525    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.088514048 +0000 UTC m=+36.088650849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : secret "router-metrics-certs-default" not found
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-bound-sa-token\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce04143-9907-44b1-bffa-8f9ca68d7cce-tmp\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.588631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a29c843-42c5-467e-8901-09eaea74437f-config-volume\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce04143-9907-44b1-bffa-8f9ca68d7cce-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-image-registry-private-configuration\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qmts\" (UniqueName: \"kubernetes.io/projected/7a29c843-42c5-467e-8901-09eaea74437f-kube-api-access-8qmts\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588680    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3d70706-f8d8-4cd0-8482-4014f647862d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-config\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.588717    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert podName:6ff4e99e-b459-44db-898e-bdd58f23e263 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.088696217 +0000 UTC m=+36.088832995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nq8pf" (UID: "6ff4e99e-b459-44db-898e-bdd58f23e263") : secret "networking-console-plugin-cert" not found
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf8x4\" (UniqueName: \"kubernetes.io/projected/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-kube-api-access-bf8x4\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d70706-f8d8-4cd0-8482-4014f647862d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ce04143-9907-44b1-bffa-8f9ca68d7cce-serving-cert\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ff4e99e-b459-44db-898e-bdd58f23e263-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-registry-certificates\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh94x\" (UniqueName: \"kubernetes.io/projected/a3d70706-f8d8-4cd0-8482-4014f647862d-kube-api-access-vh94x\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.589395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.588981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a29c843-42c5-467e-8901-09eaea74437f-tmp-dir\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6s46\" (UniqueName: \"kubernetes.io/projected/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-kube-api-access-d6s46\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-installation-pull-secrets\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ce04143-9907-44b1-bffa-8f9ca68d7cce-snapshots\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-default-certificate\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/541000a1-2cf4-413b-a73c-d55b557852d1-serving-cert\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j98k\" (UniqueName: \"kubernetes.io/projected/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-kube-api-access-6j98k\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589223    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-config\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq6dh\" (UniqueName: \"kubernetes.io/projected/32e8db40-57d9-422f-9921-efd69a90c2a6-kube-api-access-rq6dh\") pod \"ingress-canary-6dhcq\" (UID: \"32e8db40-57d9-422f-9921-efd69a90c2a6\") " pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589286    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/541000a1-2cf4-413b-a73c-d55b557852d1-config\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssqns\" (UniqueName: \"kubernetes.io/projected/541000a1-2cf4-413b-a73c-d55b557852d1-kube-api-access-ssqns\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d60c55d-f32c-4989-82e5-578078c05efb-ca-trust-extracted\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32e8db40-57d9-422f-9921-efd69a90c2a6-cert\") pod \"ingress-canary-6dhcq\" (UID: \"32e8db40-57d9-422f-9921-efd69a90c2a6\") " pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589354    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a29c843-42c5-467e-8901-09eaea74437f-config-volume\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.590055 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jllpw\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-kube-api-access-jllpw\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frdtd\" (UniqueName: \"kubernetes.io/projected/540972c4-6ade-4a03-aef0-6b7370716ce6-kube-api-access-frdtd\") pod \"volume-data-source-validator-5d456fdbcd-cvxdf\" (UID: \"540972c4-6ade-4a03-aef0-6b7370716ce6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589415    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-trusted-ca\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.589432    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.589481    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls podName:7a29c843-42c5-467e-8901-09eaea74437f nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.089467104 +0000 UTC m=+36.089603876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls") pod "dns-default-5p2g6" (UID: "7a29c843-42c5-467e-8901-09eaea74437f") : secret "dns-default-metrics-tls" not found
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.589490    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.589501    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff8579d6-866sx: secret "image-registry-tls" not found
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.589539    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls podName:4d60c55d-f32c-4989-82e5-578078c05efb nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.089523489 +0000 UTC m=+36.089660260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls") pod "image-registry-5dff8579d6-866sx" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb") : secret "image-registry-tls" not found
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.589948    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce04143-9907-44b1-bffa-8f9ca68d7cce-tmp\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.590165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce04143-9907-44b1-bffa-8f9ca68d7cce-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.590744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.590733    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2ce04143-9907-44b1-bffa-8f9ca68d7cce-snapshots\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.591164 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.590975    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a29c843-42c5-467e-8901-09eaea74437f-tmp-dir\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.591476 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591453    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-registry-certificates\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.591646 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591603    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6ff4e99e-b459-44db-898e-bdd58f23e263-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:53.591841 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591734    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/541000a1-2cf4-413b-a73c-d55b557852d1-trusted-ca\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.591945 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:53.591766    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:54.091749302 +0000 UTC m=+36.091886093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:53.591945 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591887    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-stats-auth\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.591945 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591890    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d60c55d-f32c-4989-82e5-578078c05efb-ca-trust-extracted\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.591945 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fjvf\" (UniqueName: \"kubernetes.io/projected/2ce04143-9907-44b1-bffa-8f9ca68d7cce-kube-api-access-8fjvf\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.592168 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.591969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.592168 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.592008    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce04143-9907-44b1-bffa-8f9ca68d7cce-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.592741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.592714    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ce04143-9907-44b1-bffa-8f9ca68d7cce-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.593159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.593134    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.594032 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.594008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3d70706-f8d8-4cd0-8482-4014f647862d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.594258 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.594217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-image-registry-private-configuration\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.594258 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.594227    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32e8db40-57d9-422f-9921-efd69a90c2a6-cert\") pod \"ingress-canary-6dhcq\" (UID: \"32e8db40-57d9-422f-9921-efd69a90c2a6\") " pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.594649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.594628    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-default-certificate\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.594823 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.594805    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/541000a1-2cf4-413b-a73c-d55b557852d1-serving-cert\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.594891 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.594863    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-installation-pull-secrets\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.595177 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.595159    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ce04143-9907-44b1-bffa-8f9ca68d7cce-serving-cert\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.595234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.595222    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.596301 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.596284    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-stats-auth\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.598180 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.598159    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-bound-sa-token\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.598514 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.598317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw87d\" (UniqueName: \"kubernetes.io/projected/f103cdb0-1039-4f92-8b6b-d3d4dadba1af-kube-api-access-vw87d\") pod \"service-ca-operator-5d46d9ffd4-sfxl7\" (UID: \"f103cdb0-1039-4f92-8b6b-d3d4dadba1af\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.600527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.600505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qmts\" (UniqueName: \"kubernetes.io/projected/7a29c843-42c5-467e-8901-09eaea74437f-kube-api-access-8qmts\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:53.600747 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.600727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j98k\" (UniqueName: \"kubernetes.io/projected/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-kube-api-access-6j98k\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:53.600890 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.600871    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq6dh\" (UniqueName: \"kubernetes.io/projected/32e8db40-57d9-422f-9921-efd69a90c2a6-kube-api-access-rq6dh\") pod \"ingress-canary-6dhcq\" (UID: \"32e8db40-57d9-422f-9921-efd69a90c2a6\") " pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.601715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.601655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fjvf\" (UniqueName: \"kubernetes.io/projected/2ce04143-9907-44b1-bffa-8f9ca68d7cce-kube-api-access-8fjvf\") pod \"insights-operator-5c847dcfc4-r4bzw\" (UID: \"2ce04143-9907-44b1-bffa-8f9ca68d7cce\") " pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.601715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.601661    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssqns\" (UniqueName: \"kubernetes.io/projected/541000a1-2cf4-413b-a73c-d55b557852d1-kube-api-access-ssqns\") pod \"console-operator-68b757fb67-29rmk\" (UID: \"541000a1-2cf4-413b-a73c-d55b557852d1\") " pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.601715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.601685    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frdtd\" (UniqueName: \"kubernetes.io/projected/540972c4-6ade-4a03-aef0-6b7370716ce6-kube-api-access-frdtd\") pod \"volume-data-source-validator-5d456fdbcd-cvxdf\" (UID: \"540972c4-6ade-4a03-aef0-6b7370716ce6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"
Jul 02 19:05:53.602497 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.602479    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jllpw\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-kube-api-access-jllpw\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:53.602764 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.602742    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh94x\" (UniqueName: \"kubernetes.io/projected/a3d70706-f8d8-4cd0-8482-4014f647862d-kube-api-access-vh94x\") pod \"kube-storage-version-migrator-operator-846bf668f7-rn49x\" (UID: \"a3d70706-f8d8-4cd0-8482-4014f647862d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.602948 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.602928    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf8x4\" (UniqueName: \"kubernetes.io/projected/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-kube-api-access-bf8x4\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:53.603034 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.603018    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6s46\" (UniqueName: \"kubernetes.io/projected/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-kube-api-access-d6s46\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:53.667227 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.667159    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"
Jul 02 19:05:53.690713 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.690689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"
Jul 02 19:05:53.693172 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.693145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpg6v\" (UniqueName: \"kubernetes.io/projected/ec73d99a-faf2-4896-8536-5da76e39496c-kube-api-access-rpg6v\") pod \"network-check-source-989f8b8dc-xpftx\" (UID: \"ec73d99a-faf2-4896-8536-5da76e39496c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"
Jul 02 19:05:53.703660 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.703631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw"
Jul 02 19:05:53.709425 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.709394    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpg6v\" (UniqueName: \"kubernetes.io/projected/ec73d99a-faf2-4896-8536-5da76e39496c-kube-api-access-rpg6v\") pod \"network-check-source-989f8b8dc-xpftx\" (UID: \"ec73d99a-faf2-4896-8536-5da76e39496c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"
Jul 02 19:05:53.731462 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.731420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:05:53.736605 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.736535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"
Jul 02 19:05:53.757470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.757447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6dhcq"
Jul 02 19:05:53.763098 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.763048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"
Jul 02 19:05:53.904307 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.902371    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x"]
Jul 02 19:05:53.904307 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.902694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-r4bzw"]
Jul 02 19:05:53.908834 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.908529    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7"]
Jul 02 19:05:53.963940 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.963869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-29rmk"]
Jul 02 19:05:53.969659 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:53.969624    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541000a1_2cf4_413b_a73c_d55b557852d1.slice/crio-2a72574601d85de814a89da0036ab9a445e1b61c39be0d857b039c0f356f5462 WatchSource:0}: Error finding container 2a72574601d85de814a89da0036ab9a445e1b61c39be0d857b039c0f356f5462: Status 404 returned error can't find the container with id 2a72574601d85de814a89da0036ab9a445e1b61c39be0d857b039c0f356f5462
Jul 02 19:05:53.987682 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.987656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx"]
Jul 02 19:05:53.991680 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:53.991658    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec73d99a_faf2_4896_8536_5da76e39496c.slice/crio-5069eafaae13af1cef66c48b50ddc47c31ede49bc647004f50d9d8a0fff64fc2 WatchSource:0}: Error finding container 5069eafaae13af1cef66c48b50ddc47c31ede49bc647004f50d9d8a0fff64fc2: Status 404 returned error can't find the container with id 5069eafaae13af1cef66c48b50ddc47c31ede49bc647004f50d9d8a0fff64fc2
Jul 02 19:05:53.998801 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:53.998740    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf"]
Jul 02 19:05:54.001762 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:54.001737    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540972c4_6ade_4a03_aef0_6b7370716ce6.slice/crio-f82ad238fcb96987345b2a80b5efa15538ea7611d1658f1ab255f517167493c8 WatchSource:0}: Error finding container f82ad238fcb96987345b2a80b5efa15538ea7611d1658f1ab255f517167493c8: Status 404 returned error can't find the container with id f82ad238fcb96987345b2a80b5efa15538ea7611d1658f1ab255f517167493c8
Jul 02 19:05:54.011823 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.011802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6dhcq"]
Jul 02 19:05:54.014326 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:05:54.014293    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e8db40_57d9_422f_9921_efd69a90c2a6.slice/crio-f0cb8aeabb49b1f5747b3b877287ac6bcbf8c219c97b1dae56fb591b45dab607 WatchSource:0}: Error finding container f0cb8aeabb49b1f5747b3b877287ac6bcbf8c219c97b1dae56fb591b45dab607: Status 404 returned error can't find the container with id f0cb8aeabb49b1f5747b3b877287ac6bcbf8c219c97b1dae56fb591b45dab607
Jul 02 19:05:54.099174 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:54.099348 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:54.099348 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:54.099348 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:54.099348 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:54.099348 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099312    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099369    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099382    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls podName:ef6b4cd2-464e-49f8-9aa9-3450d64e0762 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099362643 +0000 UTC m=+37.099499439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nrd2c" (UID: "ef6b4cd2-464e-49f8-9aa9-3450d64e0762") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099384    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099400    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff8579d6-866sx: secret "image-registry-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099426    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert podName:6ff4e99e-b459-44db-898e-bdd58f23e263 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099408093 +0000 UTC m=+37.099544884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nq8pf" (UID: "6ff4e99e-b459-44db-898e-bdd58f23e263") : secret "networking-console-plugin-cert" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099428    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099442    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls podName:4d60c55d-f32c-4989-82e5-578078c05efb nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099433643 +0000 UTC m=+37.099570414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls") pod "image-registry-5dff8579d6-866sx" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb") : secret "image-registry-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099371    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099463    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls podName:6a7e1acf-7b8f-4f44-8f6a-427e77b86935 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099452474 +0000 UTC m=+37.099589248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p229j" (UID: "6a7e1acf-7b8f-4f44-8f6a-427e77b86935") : secret "samples-operator-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099430    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099482    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099473672 +0000 UTC m=+37.099610462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : secret "router-metrics-certs-default" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099498    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls podName:7a29c843-42c5-467e-8901-09eaea74437f nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099491021 +0000 UTC m=+37.099627792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls") pod "dns-default-5p2g6" (UID: "7a29c843-42c5-467e-8901-09eaea74437f") : secret "dns-default-metrics-tls" not found
Jul 02 19:05:54.099599 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.099560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:54.100276 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:54.099596    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:55.099588956 +0000 UTC m=+37.099725727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:54.497400 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.497374    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:05:54.497571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.497442    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:05:54.497571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.497400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:05:54.500340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.499824    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:05:54.500340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.499885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjgvz\""
Jul 02 19:05:54.500340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.499936    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mxlv5\""
Jul 02 19:05:54.500340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.500241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:05:54.809713 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.809680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6dhcq" event={"ID":"32e8db40-57d9-422f-9921-efd69a90c2a6","Type":"ContainerStarted","Data":"f0cb8aeabb49b1f5747b3b877287ac6bcbf8c219c97b1dae56fb591b45dab607"}
Jul 02 19:05:54.810952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.810896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx" event={"ID":"ec73d99a-faf2-4896-8536-5da76e39496c","Type":"ContainerStarted","Data":"5069eafaae13af1cef66c48b50ddc47c31ede49bc647004f50d9d8a0fff64fc2"}
Jul 02 19:05:54.812083 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.812055    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7" event={"ID":"f103cdb0-1039-4f92-8b6b-d3d4dadba1af","Type":"ContainerStarted","Data":"25d112e47af16172ad1f48920c6dceac15a7829baad42dfe373830184f6befa0"}
Jul 02 19:05:54.813355 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.813312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x" event={"ID":"a3d70706-f8d8-4cd0-8482-4014f647862d","Type":"ContainerStarted","Data":"d492d4bf85336f226db16aff0ec57609a5d432a34d6bdc6eec395431d9c487b0"}
Jul 02 19:05:54.814849 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.814826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf" event={"ID":"540972c4-6ade-4a03-aef0-6b7370716ce6","Type":"ContainerStarted","Data":"f82ad238fcb96987345b2a80b5efa15538ea7611d1658f1ab255f517167493c8"}
Jul 02 19:05:54.816222 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.816179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" event={"ID":"541000a1-2cf4-413b-a73c-d55b557852d1","Type":"ContainerStarted","Data":"2a72574601d85de814a89da0036ab9a445e1b61c39be0d857b039c0f356f5462"}
Jul 02 19:05:54.817410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:54.817388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw" event={"ID":"2ce04143-9907-44b1-bffa-8f9ca68d7cce","Type":"ContainerStarted","Data":"1aff507636ef9b2e0cb904ef8cfedf9b8ba65551b5f8f2c2f7b2474b326d84c0"}
Jul 02 19:05:55.110024 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.109889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:55.110024 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.109996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.110030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110057    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.11003563 +0000 UTC m=+39.110172405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110084    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.110116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110135    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110141    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls podName:ef6b4cd2-464e-49f8-9aa9-3450d64e0762 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.11012813 +0000 UTC m=+39.110264905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nrd2c" (UID: "ef6b4cd2-464e-49f8-9aa9-3450d64e0762") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.110173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110184    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110214    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert podName:6ff4e99e-b459-44db-898e-bdd58f23e263 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.110180137 +0000 UTC m=+39.110316914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nq8pf" (UID: "6ff4e99e-b459-44db-898e-bdd58f23e263") : secret "networking-console-plugin-cert" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110234    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.110223021 +0000 UTC m=+39.110359804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : secret "router-metrics-certs-default" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110245    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:55.110273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110280    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls podName:6a7e1acf-7b8f-4f44-8f6a-427e77b86935 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.110269838 +0000 UTC m=+39.110406624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p229j" (UID: "6a7e1acf-7b8f-4f44-8f6a-427e77b86935") : secret "samples-operator-tls" not found
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.110316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:55.110335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110404    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110412    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff8579d6-866sx: secret "image-registry-tls" not found
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110431    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls podName:4d60c55d-f32c-4989-82e5-578078c05efb nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.110425295 +0000 UTC m=+39.110562066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls") pod "image-registry-5dff8579d6-866sx" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb") : secret "image-registry-tls" not found
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110474    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:05:55.111010 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:55.110492    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls podName:7a29c843-42c5-467e-8901-09eaea74437f nodeName:}" failed. No retries permitted until 2026-07-02 19:05:57.110486803 +0000 UTC m=+39.110623574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls") pod "dns-default-5p2g6" (UID: "7a29c843-42c5-467e-8901-09eaea74437f") : secret "dns-default-metrics-tls" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.126755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.126807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.126857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.126889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.126923    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.126946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.126996    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.126977311 +0000 UTC m=+43.127114089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : secret "router-metrics-certs-default" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.127071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.127098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127231    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127282    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert podName:6ff4e99e-b459-44db-898e-bdd58f23e263 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.127267743 +0000 UTC m=+43.127404515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nq8pf" (UID: "6ff4e99e-b459-44db-898e-bdd58f23e263") : secret "networking-console-plugin-cert" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127343    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127375    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls podName:6a7e1acf-7b8f-4f44-8f6a-427e77b86935 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.127364418 +0000 UTC m=+43.127501195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p229j" (UID: "6a7e1acf-7b8f-4f44-8f6a-427e77b86935") : secret "samples-operator-tls" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127394    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127409    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff8579d6-866sx: secret "image-registry-tls" not found
Jul 02 19:05:57.127559 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127440    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.127429729 +0000 UTC m=+43.127566502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:05:57.128766 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127457    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls podName:4d60c55d-f32c-4989-82e5-578078c05efb nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.127449265 +0000 UTC m=+43.127586040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls") pod "image-registry-5dff8579d6-866sx" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb") : secret "image-registry-tls" not found
Jul 02 19:05:57.128766 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127488    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:05:57.128766 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127510    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:57.128766 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127523    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls podName:7a29c843-42c5-467e-8901-09eaea74437f nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.127506985 +0000 UTC m=+43.127643761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls") pod "dns-default-5p2g6" (UID: "7a29c843-42c5-467e-8901-09eaea74437f") : secret "dns-default-metrics-tls" not found
Jul 02 19:05:57.128766 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:05:57.127540    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls podName:ef6b4cd2-464e-49f8-9aa9-3450d64e0762 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:01.127530825 +0000 UTC m=+43.127667626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nrd2c" (UID: "ef6b4cd2-464e-49f8-9aa9-3450d64e0762") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:05:57.834832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:57.834738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerStarted","Data":"ff11694da8a1eb511344602f075561faf589af833f4212e25a05f0df5a5c12d1"}
Jul 02 19:05:58.839595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:58.839567    2563 generic.go:356] "Generic (PLEG): container finished" podID="083bc306-b06d-41ff-b88a-060fb75d780c" containerID="ff11694da8a1eb511344602f075561faf589af833f4212e25a05f0df5a5c12d1" exitCode=0
Jul 02 19:05:58.839906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:05:58.839629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerDied","Data":"ff11694da8a1eb511344602f075561faf589af833f4212e25a05f0df5a5c12d1"}
Jul 02 19:06:01.166950 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.166906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:06:01.166950 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.166949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.166970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.166993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167074    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167077    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167109    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167076    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167141    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls podName:6a7e1acf-7b8f-4f44-8f6a-427e77b86935 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167121478 +0000 UTC m=+51.167258249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p229j" (UID: "6a7e1acf-7b8f-4f44-8f6a-427e77b86935") : secret "samples-operator-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.167253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.167289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167326    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167303754 +0000 UTC m=+51.167440529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : secret "router-metrics-certs-default" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167352    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert podName:6ff4e99e-b459-44db-898e-bdd58f23e263 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167344462 +0000 UTC m=+51.167481233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nq8pf" (UID: "6ff4e99e-b459-44db-898e-bdd58f23e263") : secret "networking-console-plugin-cert" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167354    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167363    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167376    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff8579d6-866sx: secret "image-registry-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167365    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls podName:ef6b4cd2-464e-49f8-9aa9-3450d64e0762 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167360501 +0000 UTC m=+51.167497272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nrd2c" (UID: "ef6b4cd2-464e-49f8-9aa9-3450d64e0762") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:06:01.167424 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167393    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls podName:7a29c843-42c5-467e-8901-09eaea74437f nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167388 +0000 UTC m=+51.167524771 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls") pod "dns-default-5p2g6" (UID: "7a29c843-42c5-467e-8901-09eaea74437f") : secret "dns-default-metrics-tls" not found
Jul 02 19:06:01.167915 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167422    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls podName:4d60c55d-f32c-4989-82e5-578078c05efb nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167408497 +0000 UTC m=+51.167545300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls") pod "image-registry-5dff8579d6-866sx" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb") : secret "image-registry-tls" not found
Jul 02 19:06:01.167915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:01.167502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:01.167915 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:01.167608    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:09.167596117 +0000 UTC m=+51.167732889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:06:03.862359 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.862330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/0.log"
Jul 02 19:06:03.862746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.862374    2563 generic.go:356] "Generic (PLEG): container finished" podID="541000a1-2cf4-413b-a73c-d55b557852d1" containerID="d097716e60a1596bc0c39897740f6551267eb4adbca4e5fa51b84308c518f156" exitCode=255
Jul 02 19:06:03.862746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.862449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" event={"ID":"541000a1-2cf4-413b-a73c-d55b557852d1","Type":"ContainerDied","Data":"d097716e60a1596bc0c39897740f6551267eb4adbca4e5fa51b84308c518f156"}
Jul 02 19:06:03.863302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.863148    2563 scope.go:117] "RemoveContainer" containerID="d097716e60a1596bc0c39897740f6551267eb4adbca4e5fa51b84308c518f156"
Jul 02 19:06:03.864133 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.864101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw" event={"ID":"2ce04143-9907-44b1-bffa-8f9ca68d7cce","Type":"ContainerStarted","Data":"3f249e011606df1509917388f95fc16dd391de177366639551228e5f017d57ea"}
Jul 02 19:06:03.867654 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.867623    2563 generic.go:356] "Generic (PLEG): container finished" podID="083bc306-b06d-41ff-b88a-060fb75d780c" containerID="fb2897d3b9fed838f0bfffff2db5de859a95d81699186b48e1f52e295bcf43db" exitCode=0
Jul 02 19:06:03.867766 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.867704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerDied","Data":"fb2897d3b9fed838f0bfffff2db5de859a95d81699186b48e1f52e295bcf43db"}
Jul 02 19:06:03.869452 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.869426    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6dhcq" event={"ID":"32e8db40-57d9-422f-9921-efd69a90c2a6","Type":"ContainerStarted","Data":"d8b539fe04f7406ae4d9ba7eae28e3ee5c53fbf6fa4dc2a699b31cd6ecb6b54d"}
Jul 02 19:06:03.871568 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.870955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx" event={"ID":"ec73d99a-faf2-4896-8536-5da76e39496c","Type":"ContainerStarted","Data":"e5f25dbc09fe08cb82f5aea7379b73eee86f677432d00162e56a1a86c99bd56d"}
Jul 02 19:06:03.872430 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.872408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7" event={"ID":"f103cdb0-1039-4f92-8b6b-d3d4dadba1af","Type":"ContainerStarted","Data":"95131c111f015e6b9f3f453d291d5804a1327129cc7221bb692690f0b005e53a"}
Jul 02 19:06:03.874239 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.874221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x" event={"ID":"a3d70706-f8d8-4cd0-8482-4014f647862d","Type":"ContainerStarted","Data":"eb0b51750697a19459e2b54c12fb55612e36d0fd934f883245fea1c80f3159c7"}
Jul 02 19:06:03.876000 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.875980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf" event={"ID":"540972c4-6ade-4a03-aef0-6b7370716ce6","Type":"ContainerStarted","Data":"df91a43a7bf392bad3523cd40a041834a2013cd4d0d9af532fe829d218755cf0"}
Jul 02 19:06:03.908428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.908272    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6dhcq" podStartSLOduration=2.13598922 podStartE2EDuration="10.908255355s" totalImagesPullingTime="8.772266135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:03.907901965 +0000 UTC m=+45.908038759" watchObservedRunningTime="2026-07-02 19:06:03.908255355 +0000 UTC m=+45.908392150"
Jul 02 19:06:03.908428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.908363    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-xpftx" podStartSLOduration=21.106598801 podStartE2EDuration="29.90835656s" totalImagesPullingTime="8.801757759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:03.893630933 +0000 UTC m=+45.893767727" watchObservedRunningTime="2026-07-02 19:06:03.90835656 +0000 UTC m=+45.908493354"
Jul 02 19:06:03.968213 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.963832    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw" podStartSLOduration=22.094705136 podStartE2EDuration="30.963812944s" totalImagesPullingTime="8.869107808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:03.962636558 +0000 UTC m=+45.962773358" watchObservedRunningTime="2026-07-02 19:06:03.963812944 +0000 UTC m=+45.963949730"
Jul 02 19:06:03.981863 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:03.981811    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7" podStartSLOduration=22.123351441 podStartE2EDuration="30.981790407s" totalImagesPullingTime="8.858438966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:03.981069535 +0000 UTC m=+45.981206328" watchObservedRunningTime="2026-07-02 19:06:03.981790407 +0000 UTC m=+45.981927203"
Jul 02 19:06:04.018237 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.018174    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x" podStartSLOduration=22.572534164 podStartE2EDuration="31.018155331s" totalImagesPullingTime="8.445621167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:03.998701627 +0000 UTC m=+45.998838418" watchObservedRunningTime="2026-07-02 19:06:04.018155331 +0000 UTC m=+46.018292127"
Jul 02 19:06:04.018777 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.018749    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-cvxdf" podStartSLOduration=22.236537028 podStartE2EDuration="31.018741691s" totalImagesPullingTime="8.782204663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:04.017294934 +0000 UTC m=+46.017431725" watchObservedRunningTime="2026-07-02 19:06:04.018741691 +0000 UTC m=+46.018878486"
Jul 02 19:06:04.414066 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.413998    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ntfzt"]
Jul 02 19:06:04.428462 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.427859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.428462 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.428145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntfzt"]
Jul 02 19:06:04.434376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.434332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sbf27\""
Jul 02 19:06:04.434539 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.434508    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:06:04.434660 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.434564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:06:04.503565 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.503538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d5be52e-e631-404e-8854-0810c7edf2f2-crio-socket\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.503701 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.503654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d5be52e-e631-404e-8854-0810c7edf2f2-data-volume\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.503701 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.503684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.503798 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.503729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cws5\" (UniqueName: \"kubernetes.io/projected/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-api-access-5cws5\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.503798 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.503754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.604450 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.604420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cws5\" (UniqueName: \"kubernetes.io/projected/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-api-access-5cws5\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.604619 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.604459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.604619 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.604511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d5be52e-e631-404e-8854-0810c7edf2f2-crio-socket\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.604721 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.604696    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d5be52e-e631-404e-8854-0810c7edf2f2-crio-socket\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.604870 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:04.604801    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:04.604870 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:04.604867    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:05.104847575 +0000 UTC m=+47.104984363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:04.604988 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.604938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d5be52e-e631-404e-8854-0810c7edf2f2-data-volume\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.604988 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.604973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.605083 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:04.605055    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:06:04.605149 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:04.605093    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:05.105080774 +0000 UTC m=+47.105217563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:06:04.605432 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.605406    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d5be52e-e631-404e-8854-0810c7edf2f2-data-volume\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.613477 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.613458    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cws5\" (UniqueName: \"kubernetes.io/projected/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-api-access-5cws5\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:04.881297 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.881272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:06:04.881700 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.881684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/0.log"
Jul 02 19:06:04.881765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.881713    2563 generic.go:356] "Generic (PLEG): container finished" podID="541000a1-2cf4-413b-a73c-d55b557852d1" containerID="fb305410b94959176988d4ea37e34e4c37023ef1090220cc61f8c681ee0bf5f0" exitCode=255
Jul 02 19:06:04.881817 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.881782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" event={"ID":"541000a1-2cf4-413b-a73c-d55b557852d1","Type":"ContainerDied","Data":"fb305410b94959176988d4ea37e34e4c37023ef1090220cc61f8c681ee0bf5f0"}
Jul 02 19:06:04.881861 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.881850    2563 scope.go:117] "RemoveContainer" containerID="d097716e60a1596bc0c39897740f6551267eb4adbca4e5fa51b84308c518f156"
Jul 02 19:06:04.882062 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.882040    2563 scope.go:117] "RemoveContainer" containerID="fb305410b94959176988d4ea37e34e4c37023ef1090220cc61f8c681ee0bf5f0"
Jul 02 19:06:04.882273 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:04.882250    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-29rmk_openshift-console-operator(541000a1-2cf4-413b-a73c-d55b557852d1)\"" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" podUID="541000a1-2cf4-413b-a73c-d55b557852d1"
Jul 02 19:06:04.885103 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.885085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" event={"ID":"083bc306-b06d-41ff-b88a-060fb75d780c","Type":"ContainerStarted","Data":"c28c5979fb16f43ed0386babc08dddcf2c63d2805e455f2ed5c5f95dfc9b6e3e"}
Jul 02 19:06:04.920900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:04.920851    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lv8kl" podStartSLOduration=13.499300958 podStartE2EDuration="46.920836342s" totalImagesPullingTime="33.421535384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:04.920290154 +0000 UTC m=+46.920426947" watchObservedRunningTime="2026-07-02 19:06:04.920836342 +0000 UTC m=+46.920973134"
Jul 02 19:06:05.109768 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:05.109736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:05.109911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:05.109792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:05.109911 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:05.109858    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:06:05.109970 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:05.109935    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:06.109917678 +0000 UTC m=+48.110054452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:06:05.109970 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:05.109948    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:05.110056 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:05.110009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:06.109996413 +0000 UTC m=+48.110133189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:05.889976 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:05.889946    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:06:05.890434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:05.890277    2563 scope.go:117] "RemoveContainer" containerID="fb305410b94959176988d4ea37e34e4c37023ef1090220cc61f8c681ee0bf5f0"
Jul 02 19:06:05.890501 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:05.890426    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-29rmk_openshift-console-operator(541000a1-2cf4-413b-a73c-d55b557852d1)\"" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" podUID="541000a1-2cf4-413b-a73c-d55b557852d1"
Jul 02 19:06:06.118533 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:06.118500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:06.118694 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:06.118567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:06.118694 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:06.118622    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:06:06.118756 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:06.118698    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:08.118681895 +0000 UTC m=+50.118818673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:06:06.118756 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:06.118713    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:06.118815 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:06.118761    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:08.118749231 +0000 UTC m=+50.118886002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:06.203164 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:06.203086    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-77ddp_25c836c0-6750-4015-a46d-f9da2e851165/dns-node-resolver/0.log"
Jul 02 19:06:07.213977 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:07.213952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-24vp7_56a93b7a-7b85-4591-92d4-37fcfb0c8cd4/node-ca/0.log"
Jul 02 19:06:08.005154 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:08.005123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6dhcq_32e8db40-57d9-422f-9921-efd69a90c2a6/serve-healthcheck-canary/0.log"
Jul 02 19:06:08.136365 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:08.136329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:08.136512 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:08.136398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:08.136512 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:08.136447    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:06:08.136512 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:08.136480    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:08.136512 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:08.136507    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:12.136492378 +0000 UTC m=+54.136629149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:06:08.136661 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:08.136525    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:12.136513359 +0000 UTC m=+54.136650134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:09.244992 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.244951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:09.244992 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.244996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.245045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.245098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245110    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245156    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245167    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.245116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245172    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dff8579d6-866sx: secret "image-registry-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245210    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.245171695 +0000 UTC m=+67.245308476 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : configmap references non-existent config key: service-ca.crt
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245242    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls podName:7a29c843-42c5-467e-8901-09eaea74437f nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.245232162 +0000 UTC m=+67.245368934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls") pod "dns-default-5p2g6" (UID: "7a29c843-42c5-467e-8901-09eaea74437f") : secret "dns-default-metrics-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245260    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert podName:6ff4e99e-b459-44db-898e-bdd58f23e263 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.245251524 +0000 UTC m=+67.245388295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-nq8pf" (UID: "6ff4e99e-b459-44db-898e-bdd58f23e263") : secret "networking-console-plugin-cert" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245275    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls podName:4d60c55d-f32c-4989-82e5-578078c05efb nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.245267548 +0000 UTC m=+67.245404322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls") pod "image-registry-5dff8579d6-866sx" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb") : secret "image-registry-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245293    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.245321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245347    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls podName:ef6b4cd2-464e-49f8-9aa9-3450d64e0762 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.245335577 +0000 UTC m=+67.245472365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nrd2c" (UID: "ef6b4cd2-464e-49f8-9aa9-3450d64e0762") : secret "cluster-monitoring-operator-tls" not found
Jul 02 19:06:09.245558 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:09.245377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:06:09.246008 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245393    2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 19:06:09.246008 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245423    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs podName:329fe1ed-f48d-4fb4-a2d2-0c5205236e8a nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.245413875 +0000 UTC m=+67.245550647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs") pod "router-default-5cd975f88c-dch65" (UID: "329fe1ed-f48d-4fb4-a2d2-0c5205236e8a") : secret "router-metrics-certs-default" not found
Jul 02 19:06:09.246008 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245460    2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:06:09.246008 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:09.245496    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls podName:6a7e1acf-7b8f-4f44-8f6a-427e77b86935 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:25.24548571 +0000 UTC m=+67.245622490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-p229j" (UID: "6a7e1acf-7b8f-4f44-8f6a-427e77b86935") : secret "samples-operator-tls" not found
Jul 02 19:06:12.171166 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:12.171114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:12.171673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:12.171215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:12.171673 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:12.171356    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:12.171673 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:12.171424    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls podName:7d5be52e-e631-404e-8854-0810c7edf2f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:20.171404139 +0000 UTC m=+62.171540911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ntfzt" (UID: "7d5be52e-e631-404e-8854-0810c7edf2f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:06:12.171673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:12.171622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d5be52e-e631-404e-8854-0810c7edf2f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:13.732325 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:13.732279    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:06:13.732712 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:13.732364    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:06:13.732712 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:13.732660    2563 scope.go:117] "RemoveContainer" containerID="fb305410b94959176988d4ea37e34e4c37023ef1090220cc61f8c681ee0bf5f0"
Jul 02 19:06:13.732810 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:13.732790    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-29rmk_openshift-console-operator(541000a1-2cf4-413b-a73c-d55b557852d1)\"" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" podUID="541000a1-2cf4-413b-a73c-d55b557852d1"
Jul 02 19:06:18.800899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:18.800870    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qgkkd"
Jul 02 19:06:20.245395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:20.245358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:20.247744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:20.247724    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d5be52e-e631-404e-8854-0810c7edf2f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ntfzt\" (UID: \"7d5be52e-e631-404e-8854-0810c7edf2f2\") " pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:20.342346 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:20.342318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sbf27\""
Jul 02 19:06:20.350778 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:20.350760    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ntfzt"
Jul 02 19:06:20.468401 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:20.468372    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ntfzt"]
Jul 02 19:06:20.470997 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:20.470969    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5be52e_e631_404e_8854_0810c7edf2f2.slice/crio-30f43ac4777dfc54c9ecada761efd7c931f3854a6e37a31292ede366cda7bf62 WatchSource:0}: Error finding container 30f43ac4777dfc54c9ecada761efd7c931f3854a6e37a31292ede366cda7bf62: Status 404 returned error can't find the container with id 30f43ac4777dfc54c9ecada761efd7c931f3854a6e37a31292ede366cda7bf62
Jul 02 19:06:20.939113 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:20.939029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntfzt" event={"ID":"7d5be52e-e631-404e-8854-0810c7edf2f2","Type":"ContainerStarted","Data":"30f43ac4777dfc54c9ecada761efd7c931f3854a6e37a31292ede366cda7bf62"}
Jul 02 19:06:23.073780 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.073735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:06:23.074259 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.073904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:06:23.076458 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.076419    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:06:23.077138 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.077112    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:06:23.087286 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.087251    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14c46bc5-e149-424d-980b-b42c710f91de-original-pull-secret\") pod \"global-pull-secret-syncer-mz5fw\" (UID: \"14c46bc5-e149-424d-980b-b42c710f91de\") " pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:06:23.087286 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.087262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1354ecb0-9981-4f7c-bff7-560eab7366d8-metrics-certs\") pod \"network-metrics-daemon-szbkd\" (UID: \"1354ecb0-9981-4f7c-bff7-560eab7366d8\") " pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:06:23.175288 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.175250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:06:23.177822 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.177793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kqv2\" (UniqueName: \"kubernetes.io/projected/57c531ef-1875-43f5-89dd-3824fe3e7d49-kube-api-access-7kqv2\") pod \"network-check-target-j5cz5\" (UID: \"57c531ef-1875-43f5-89dd-3824fe3e7d49\") " pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:06:23.313391 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.313356    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mxlv5\""
Jul 02 19:06:23.321109 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.321086    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjgvz\""
Jul 02 19:06:23.321282 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.321154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:06:23.326054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.325991    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mz5fw"
Jul 02 19:06:23.329491 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:23.329473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-szbkd"
Jul 02 19:06:24.255999 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.255943    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-szbkd"]
Jul 02 19:06:24.260651 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:24.260622    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1354ecb0_9981_4f7c_bff7_560eab7366d8.slice/crio-2707a5f321b532c34bf1ddd15e39384234f2ce66faf1d8becf4954af81ff36da WatchSource:0}: Error finding container 2707a5f321b532c34bf1ddd15e39384234f2ce66faf1d8becf4954af81ff36da: Status 404 returned error can't find the container with id 2707a5f321b532c34bf1ddd15e39384234f2ce66faf1d8becf4954af81ff36da
Jul 02 19:06:24.270818 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.270786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j5cz5"]
Jul 02 19:06:24.275404 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:24.275377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c531ef_1875_43f5_89dd_3824fe3e7d49.slice/crio-e3565a9ca90c03e6b65d6469c5c52ec3a5b7a2020d51b4784bc146a6392c1dde WatchSource:0}: Error finding container e3565a9ca90c03e6b65d6469c5c52ec3a5b7a2020d51b4784bc146a6392c1dde: Status 404 returned error can't find the container with id e3565a9ca90c03e6b65d6469c5c52ec3a5b7a2020d51b4784bc146a6392c1dde
Jul 02 19:06:24.288287 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.288257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mz5fw"]
Jul 02 19:06:24.291028 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:24.291005    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14c46bc5_e149_424d_980b_b42c710f91de.slice/crio-f06c64f153b311cb0f81f6bac659eef15b881de9b48db04969c9647d6c15de68 WatchSource:0}: Error finding container f06c64f153b311cb0f81f6bac659eef15b881de9b48db04969c9647d6c15de68: Status 404 returned error can't find the container with id f06c64f153b311cb0f81f6bac659eef15b881de9b48db04969c9647d6c15de68
Jul 02 19:06:24.956496 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.956459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5cz5" event={"ID":"57c531ef-1875-43f5-89dd-3824fe3e7d49","Type":"ContainerStarted","Data":"89de059e353f36bdae1e8d47ecfd4359f63fed4dbd57e30fb279d8e1d44bf677"}
Jul 02 19:06:24.956701 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.956521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j5cz5" event={"ID":"57c531ef-1875-43f5-89dd-3824fe3e7d49","Type":"ContainerStarted","Data":"e3565a9ca90c03e6b65d6469c5c52ec3a5b7a2020d51b4784bc146a6392c1dde"}
Jul 02 19:06:24.956701 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.956565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:06:24.957686 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.957657    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szbkd" event={"ID":"1354ecb0-9981-4f7c-bff7-560eab7366d8","Type":"ContainerStarted","Data":"2707a5f321b532c34bf1ddd15e39384234f2ce66faf1d8becf4954af81ff36da"}
Jul 02 19:06:24.959077 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.959052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mz5fw" event={"ID":"14c46bc5-e149-424d-980b-b42c710f91de","Type":"ContainerStarted","Data":"f06c64f153b311cb0f81f6bac659eef15b881de9b48db04969c9647d6c15de68"}
Jul 02 19:06:24.960944 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.960922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntfzt" event={"ID":"7d5be52e-e631-404e-8854-0810c7edf2f2","Type":"ContainerStarted","Data":"f04b3567e863c99332558d9f6b3946220f86b3a08343527e2104c98bd301e061"}
Jul 02 19:06:24.961033 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.960967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntfzt" event={"ID":"7d5be52e-e631-404e-8854-0810c7edf2f2","Type":"ContainerStarted","Data":"f3e5fd7c0b374a5d13b2205dc0e7bc9cc8625c65eb017192fa4ecd30e5bf2aaa"}
Jul 02 19:06:24.983266 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:24.983232    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j5cz5" podStartSLOduration=66.983219233 podStartE2EDuration="1m6.983219233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:24.981312774 +0000 UTC m=+66.981449566" watchObservedRunningTime="2026-07-02 19:06:24.983219233 +0000 UTC m=+66.983356027"
Jul 02 19:06:25.292210 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:06:25.292595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:06:25.292595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:25.292595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:06:25.292595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:25.292595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:25.292595 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.292425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:25.293208 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.293129    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-service-ca-bundle\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:25.295970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.295721    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/329fe1ed-f48d-4fb4-a2d2-0c5205236e8a-metrics-certs\") pod \"router-default-5cd975f88c-dch65\" (UID: \"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a\") " pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:25.296569 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.296085    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"image-registry-5dff8579d6-866sx\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") " pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:25.296569 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.296526    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef6b4cd2-464e-49f8-9aa9-3450d64e0762-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nrd2c\" (UID: \"ef6b4cd2-464e-49f8-9aa9-3450d64e0762\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:06:25.297146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.297121    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a7e1acf-7b8f-4f44-8f6a-427e77b86935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-p229j\" (UID: \"6a7e1acf-7b8f-4f44-8f6a-427e77b86935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:06:25.297325 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.297305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a29c843-42c5-467e-8901-09eaea74437f-metrics-tls\") pod \"dns-default-5p2g6\" (UID: \"7a29c843-42c5-467e-8901-09eaea74437f\") " pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:25.297503 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.297480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6ff4e99e-b459-44db-898e-bdd58f23e263-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-nq8pf\" (UID: \"6ff4e99e-b459-44db-898e-bdd58f23e263\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:06:25.459741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.459660    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-68mj4\""
Jul 02 19:06:25.467754 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.467582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:25.485175 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.485149    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m6n62\""
Jul 02 19:06:25.493219 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.493131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"
Jul 02 19:06:25.516982 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.516761    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-n2m97\""
Jul 02 19:06:25.524852 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.524817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"
Jul 02 19:06:25.525012 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.524891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-72rrm\""
Jul 02 19:06:25.533561 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.533293    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:25.547935 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.547711    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crw8l\""
Jul 02 19:06:25.553805 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.553606    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-drbcx\""
Jul 02 19:06:25.554766 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.554594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:25.561585 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.561561    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"
Jul 02 19:06:25.681649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.678369    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dff8579d6-866sx"]
Jul 02 19:06:25.716183 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.716147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c"]
Jul 02 19:06:25.723941 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:25.723761    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6b4cd2_464e_49f8_9aa9_3450d64e0762.slice/crio-86f92a348f2c07ba0d69c3cdc7d4cd6c4ae8ccc0fdaf7d19f0baf01499588bcc WatchSource:0}: Error finding container 86f92a348f2c07ba0d69c3cdc7d4cd6c4ae8ccc0fdaf7d19f0baf01499588bcc: Status 404 returned error can't find the container with id 86f92a348f2c07ba0d69c3cdc7d4cd6c4ae8ccc0fdaf7d19f0baf01499588bcc
Jul 02 19:06:25.755121 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.755042    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j"]
Jul 02 19:06:25.784557 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.783244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cd975f88c-dch65"]
Jul 02 19:06:25.787358 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:25.787317    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329fe1ed_f48d_4fb4_a2d2_0c5205236e8a.slice/crio-7e184576c1f6fd936e0cff109faac28feac75aef7008b5527e67dd751629d73d WatchSource:0}: Error finding container 7e184576c1f6fd936e0cff109faac28feac75aef7008b5527e67dd751629d73d: Status 404 returned error can't find the container with id 7e184576c1f6fd936e0cff109faac28feac75aef7008b5527e67dd751629d73d
Jul 02 19:06:25.970590 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.970494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cd975f88c-dch65" event={"ID":"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a","Type":"ContainerStarted","Data":"0000b89d9a7afdac81072f1411ea10e169ddde268872746c03695ebe62a6698d"}
Jul 02 19:06:25.970590 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.970561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cd975f88c-dch65" event={"ID":"329fe1ed-f48d-4fb4-a2d2-0c5205236e8a","Type":"ContainerStarted","Data":"7e184576c1f6fd936e0cff109faac28feac75aef7008b5527e67dd751629d73d"}
Jul 02 19:06:25.973687 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.973597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" event={"ID":"4d60c55d-f32c-4989-82e5-578078c05efb","Type":"ContainerStarted","Data":"8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a"}
Jul 02 19:06:25.973687 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.973651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" event={"ID":"4d60c55d-f32c-4989-82e5-578078c05efb","Type":"ContainerStarted","Data":"9ad7e4a7b77c756e9f63a56006760f2ecec79e172e68b43a60f4feeb058808f0"}
Jul 02 19:06:25.973894 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.973704    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:25.975780 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.975755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szbkd" event={"ID":"1354ecb0-9981-4f7c-bff7-560eab7366d8","Type":"ContainerStarted","Data":"54f6fe8ad903fb1795f388bd5f2331caf26903413343a776f370290828f45a7b"}
Jul 02 19:06:25.975902 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.975801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-szbkd" event={"ID":"1354ecb0-9981-4f7c-bff7-560eab7366d8","Type":"ContainerStarted","Data":"d56517382cb092ce17756e3c2dd6be8c34ac539e4c4bc53e983b0df2d205bc01"}
Jul 02 19:06:25.978705 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.978627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j" event={"ID":"6a7e1acf-7b8f-4f44-8f6a-427e77b86935","Type":"ContainerStarted","Data":"e2d937b3f9ccbf606de08c66e8ec87dc958de5572be109912474b94f8f911824"}
Jul 02 19:06:25.981697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.981643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c" event={"ID":"ef6b4cd2-464e-49f8-9aa9-3450d64e0762","Type":"ContainerStarted","Data":"86f92a348f2c07ba0d69c3cdc7d4cd6c4ae8ccc0fdaf7d19f0baf01499588bcc"}
Jul 02 19:06:25.998089 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:25.998039    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5cd975f88c-dch65" podStartSLOduration=52.998020966 podStartE2EDuration="52.998020966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:25.995092852 +0000 UTC m=+67.995229644" watchObservedRunningTime="2026-07-02 19:06:25.998020966 +0000 UTC m=+67.998157759"
Jul 02 19:06:26.048246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.048068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-szbkd" podStartSLOduration=67.182326999 podStartE2EDuration="1m8.048044699s" totalImagesPullingTime="865.7177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:26.045445968 +0000 UTC m=+68.045582762" watchObservedRunningTime="2026-07-02 19:06:26.048044699 +0000 UTC m=+68.048181495"
Jul 02 19:06:26.051905 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.050104    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5p2g6"]
Jul 02 19:06:26.057805 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:26.057776    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a29c843_42c5_467e_8901_09eaea74437f.slice/crio-082a58bc2de24dd0584e6e23d7722b4bf8b659b85f8eb2294b76f631b8d8853c WatchSource:0}: Error finding container 082a58bc2de24dd0584e6e23d7722b4bf8b659b85f8eb2294b76f631b8d8853c: Status 404 returned error can't find the container with id 082a58bc2de24dd0584e6e23d7722b4bf8b659b85f8eb2294b76f631b8d8853c
Jul 02 19:06:26.083449 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.082349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf"]
Jul 02 19:06:26.101518 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.101442    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" podStartSLOduration=67.101422202 podStartE2EDuration="1m7.101422202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:26.100032047 +0000 UTC m=+68.100168855" watchObservedRunningTime="2026-07-02 19:06:26.101422202 +0000 UTC m=+68.101558995"
Jul 02 19:06:26.535915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.534769    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:26.538739 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.538546    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:26.988510 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.988367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf" event={"ID":"6ff4e99e-b459-44db-898e-bdd58f23e263","Type":"ContainerStarted","Data":"eb5612a069288b495a57f263cf9f464a2f27d89684589376e72fa05c4ddec406"}
Jul 02 19:06:26.993322 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.992731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5p2g6" event={"ID":"7a29c843-42c5-467e-8901-09eaea74437f","Type":"ContainerStarted","Data":"082a58bc2de24dd0584e6e23d7722b4bf8b659b85f8eb2294b76f631b8d8853c"}
Jul 02 19:06:26.993322 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.992791    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:26.994426 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:26.994404    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cd975f88c-dch65"
Jul 02 19:06:28.490771 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:28.490741    2563 scope.go:117] "RemoveContainer" containerID="fb305410b94959176988d4ea37e34e4c37023ef1090220cc61f8c681ee0bf5f0"
Jul 02 19:06:33.018099 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.018008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ntfzt" event={"ID":"7d5be52e-e631-404e-8854-0810c7edf2f2","Type":"ContainerStarted","Data":"a7544666f0a2a8bde65a0685d812860e42903c9248c053fd3d4a8f3b737ce1a4"}
Jul 02 19:06:33.020394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.020365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf" event={"ID":"6ff4e99e-b459-44db-898e-bdd58f23e263","Type":"ContainerStarted","Data":"bbea5eced085a9b36ff2155aa2c7d7ff3de7b13a2bfe47a99551b573370603cb"}
Jul 02 19:06:33.022436 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.022416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:06:33.022528 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.022496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" event={"ID":"541000a1-2cf4-413b-a73c-d55b557852d1","Type":"ContainerStarted","Data":"6caff45a32ce1509baee019227cbe89d436a6ee3c78a6328eae4db83bf7113e1"}
Jul 02 19:06:33.022832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.022781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:06:33.024850 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.024822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5p2g6" event={"ID":"7a29c843-42c5-467e-8901-09eaea74437f","Type":"ContainerStarted","Data":"1d5c518fda2342ba528559369cfd84d0edf392f8f09836498e3329d21837d353"}
Jul 02 19:06:33.024962 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.024871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5p2g6" event={"ID":"7a29c843-42c5-467e-8901-09eaea74437f","Type":"ContainerStarted","Data":"1d3b055097193a15d0dd1425ec136062f7d19c58653b8e1f0b444e5c19ae9b9c"}
Jul 02 19:06:33.025021 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.024949    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:33.026368 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.026347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mz5fw" event={"ID":"14c46bc5-e149-424d-980b-b42c710f91de","Type":"ContainerStarted","Data":"7bbb4775ee6bbcf102b1e9c14c9c246487fd6f440223b4f8db5dd367b25bd3b8"}
Jul 02 19:06:33.028244 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.028224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j" event={"ID":"6a7e1acf-7b8f-4f44-8f6a-427e77b86935","Type":"ContainerStarted","Data":"c1acea070445f84a6c43f93faa9e11c4a7fe72c9183644b96811fbdfe878cf4a"}
Jul 02 19:06:33.028343 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.028269    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j" event={"ID":"6a7e1acf-7b8f-4f44-8f6a-427e77b86935","Type":"ContainerStarted","Data":"cde263860660bb4cab2b8961b17e1960432231d53f56d973e841180f64838224"}
Jul 02 19:06:33.029910 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.029893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c" event={"ID":"ef6b4cd2-464e-49f8-9aa9-3450d64e0762","Type":"ContainerStarted","Data":"db136008116962a102f438ecac02656618574565e9936cf9af4153113170325d"}
Jul 02 19:06:33.038121 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.038073    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ntfzt" podStartSLOduration=17.100775713 podStartE2EDuration="29.038058094s" totalImagesPullingTime="11.937282381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:06:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.037106835 +0000 UTC m=+75.037243628" watchObservedRunningTime="2026-07-02 19:06:33.038058094 +0000 UTC m=+75.038194869"
Jul 02 19:06:33.052026 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.051979    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nrd2c" podStartSLOduration=53.235189548 podStartE2EDuration="1m0.051962564s" totalImagesPullingTime="6.816773016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.051478123 +0000 UTC m=+75.051614914" watchObservedRunningTime="2026-07-02 19:06:33.051962564 +0000 UTC m=+75.052099359"
Jul 02 19:06:33.069461 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.069417    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-p229j" podStartSLOduration=53.328643873 podStartE2EDuration="1m0.069402388s" totalImagesPullingTime="6.740758515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.068951091 +0000 UTC m=+75.069087887" watchObservedRunningTime="2026-07-02 19:06:33.069402388 +0000 UTC m=+75.069539181"
Jul 02 19:06:33.090448 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.090406    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-29rmk" podStartSLOduration=51.273747901 podStartE2EDuration="1m0.090392828s" totalImagesPullingTime="8.816644927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.090150852 +0000 UTC m=+75.090287644" watchObservedRunningTime="2026-07-02 19:06:33.090392828 +0000 UTC m=+75.090529620"
Jul 02 19:06:33.107944 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.107894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5p2g6" podStartSLOduration=33.625340806 podStartE2EDuration="40.107879557s" totalImagesPullingTime="6.482538751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.106984349 +0000 UTC m=+75.107121153" watchObservedRunningTime="2026-07-02 19:06:33.107879557 +0000 UTC m=+75.108016350"
Jul 02 19:06:33.123059 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.123020    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-nq8pf" podStartSLOduration=47.660407121 podStartE2EDuration="54.123006527s" totalImagesPullingTime="6.462599406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.122884141 +0000 UTC m=+75.123020927" watchObservedRunningTime="2026-07-02 19:06:33.123006527 +0000 UTC m=+75.123143319"
Jul 02 19:06:33.138940 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.138896    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mz5fw" podStartSLOduration=66.877382392 podStartE2EDuration="1m15.138874468s" totalImagesPullingTime="8.261492076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:33.13846105 +0000 UTC m=+75.138597856" watchObservedRunningTime="2026-07-02 19:06:33.138874468 +0000 UTC m=+75.139011264"
Jul 02 19:06:33.183516 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.183488    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"]
Jul 02 19:06:33.199451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.199427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"]
Jul 02 19:06:33.199589 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.199525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:33.201986 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.201964    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 19:06:33.202100 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.202026    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ld27k\""
Jul 02 19:06:33.299183 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.299107    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-29rmk"
Jul 02 19:06:33.365179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.365149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77aeca4f-0beb-4de0-9550-615a49c05e67-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dpbbf\" (UID: \"77aeca4f-0beb-4de0-9550-615a49c05e67\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:33.466158 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.466126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77aeca4f-0beb-4de0-9550-615a49c05e67-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dpbbf\" (UID: \"77aeca4f-0beb-4de0-9550-615a49c05e67\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:33.468463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.468439    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77aeca4f-0beb-4de0-9550-615a49c05e67-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dpbbf\" (UID: \"77aeca4f-0beb-4de0-9550-615a49c05e67\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:33.471532 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.471501    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-jwkvq"]
Jul 02 19:06:33.487706 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.487682    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-jwkvq"]
Jul 02 19:06:33.487813 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.487794    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:33.490628 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.490606    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:06:33.490890 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.490872    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z6zxw\""
Jul 02 19:06:33.491125 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.491111    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:06:33.508687 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.508667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:33.652761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.652733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"]
Jul 02 19:06:33.655710 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:33.655683    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77aeca4f_0beb_4de0_9550_615a49c05e67.slice/crio-089164e81d9f3b3952efdea99c81594a8263d4500c9d44c29a3232011a8f75dd WatchSource:0}: Error finding container 089164e81d9f3b3952efdea99c81594a8263d4500c9d44c29a3232011a8f75dd: Status 404 returned error can't find the container with id 089164e81d9f3b3952efdea99c81594a8263d4500c9d44c29a3232011a8f75dd
Jul 02 19:06:33.668761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.668737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5mpj\" (UniqueName: \"kubernetes.io/projected/26c2c3e6-f544-489f-912e-982dbafffff5-kube-api-access-d5mpj\") pod \"downloads-685bfb5f64-jwkvq\" (UID: \"26c2c3e6-f544-489f-912e-982dbafffff5\") " pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:33.769303 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.769260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5mpj\" (UniqueName: \"kubernetes.io/projected/26c2c3e6-f544-489f-912e-982dbafffff5-kube-api-access-d5mpj\") pod \"downloads-685bfb5f64-jwkvq\" (UID: \"26c2c3e6-f544-489f-912e-982dbafffff5\") " pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:33.777317 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.777291    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5mpj\" (UniqueName: \"kubernetes.io/projected/26c2c3e6-f544-489f-912e-982dbafffff5-kube-api-access-d5mpj\") pod \"downloads-685bfb5f64-jwkvq\" (UID: \"26c2c3e6-f544-489f-912e-982dbafffff5\") " pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:33.797157 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.797130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:33.954545 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:33.954511    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-jwkvq"]
Jul 02 19:06:33.960510 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:33.960487    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c2c3e6_f544_489f_912e_982dbafffff5.slice/crio-8ece45d1b8b0aefe7cf4e51723d4df1a97ffc566912f014a94b8263fcf6a36e1 WatchSource:0}: Error finding container 8ece45d1b8b0aefe7cf4e51723d4df1a97ffc566912f014a94b8263fcf6a36e1: Status 404 returned error can't find the container with id 8ece45d1b8b0aefe7cf4e51723d4df1a97ffc566912f014a94b8263fcf6a36e1
Jul 02 19:06:34.034951 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:34.034921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf" event={"ID":"77aeca4f-0beb-4de0-9550-615a49c05e67","Type":"ContainerStarted","Data":"089164e81d9f3b3952efdea99c81594a8263d4500c9d44c29a3232011a8f75dd"}
Jul 02 19:06:34.036119 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:34.036092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-jwkvq" event={"ID":"26c2c3e6-f544-489f-912e-982dbafffff5","Type":"ContainerStarted","Data":"8ece45d1b8b0aefe7cf4e51723d4df1a97ffc566912f014a94b8263fcf6a36e1"}
Jul 02 19:06:36.046552 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:36.046519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf" event={"ID":"77aeca4f-0beb-4de0-9550-615a49c05e67","Type":"ContainerStarted","Data":"fd6d0846031847ea67814b21a8f7660254b70a6dc1d5bcc5505ac05e30dfb822"}
Jul 02 19:06:36.047219 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:36.047174    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:36.052541 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:36.052513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf"
Jul 02 19:06:36.065258 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:36.065216    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dpbbf" podStartSLOduration=1.60888599 podStartE2EDuration="3.065179394s" totalImagesPullingTime="1.456293404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:36.064728212 +0000 UTC m=+78.064865006" watchObservedRunningTime="2026-07-02 19:06:36.065179394 +0000 UTC m=+78.065316191"
Jul 02 19:06:40.612228 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.612082    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"]
Jul 02 19:06:40.616653 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.616632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.619328 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.619301    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 19:06:40.619457 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.619348    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 19:06:40.619457 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.619361    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-l5whs\""
Jul 02 19:06:40.620239 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.620221    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:06:40.628509 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.628488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"]
Jul 02 19:06:40.652203 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.652174    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8ccm7"]
Jul 02 19:06:40.655650 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.655631    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"]
Jul 02 19:06:40.655799 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.655777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.658170 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.658146    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:06:40.658291 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.658153    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p6znq\""
Jul 02 19:06:40.658291 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.658158    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:06:40.658571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.658555    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:06:40.659090 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.659075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.661189 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.661173    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 02 19:06:40.661299 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.661264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 02 19:06:40.661537 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.661522    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7tlmf\""
Jul 02 19:06:40.661580 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.661564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 02 19:06:40.671722 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.671700    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"]
Jul 02 19:06:40.732830 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.732796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.733022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.732859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9d15339-0974-4965-8663-684dadaa99db-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.733022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.732934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7pw\" (UniqueName: \"kubernetes.io/projected/b9d15339-0974-4965-8663-684dadaa99db-kube-api-access-pq7pw\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.733146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.733051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.833648 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.833648 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-sys\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.833900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.833900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-textfile\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.833900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.833900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.833900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.833990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-root\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whxb9\" (UniqueName: \"kubernetes.io/projected/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-api-access-whxb9\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:40.834033    2563 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.834147 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:40.834102    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-tls podName:b9d15339-0974-4965-8663-684dadaa99db nodeName:}" failed. No retries permitted until 2026-07-02 19:06:41.334079256 +0000 UTC m=+83.334216030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-dm7l2" (UID: "b9d15339-0974-4965-8663-684dadaa99db") : secret "openshift-state-metrics-tls" not found
Jul 02 19:06:40.834592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9d15339-0974-4965-8663-684dadaa99db-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.834592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-wtmp\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.834592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7pw\" (UniqueName: \"kubernetes.io/projected/b9d15339-0974-4965-8663-684dadaa99db-kube-api-access-pq7pw\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.834592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-tls\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.834592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66391b02-53a4-4693-94d1-dce9e9cb08d0-metrics-client-ca\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.834592 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.834557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6wb\" (UniqueName: \"kubernetes.io/projected/66391b02-53a4-4693-94d1-dce9e9cb08d0-kube-api-access-jq6wb\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.835443 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.835406    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9d15339-0974-4965-8663-684dadaa99db-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.837373 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.837334    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.844429 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.844392    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7pw\" (UniqueName: \"kubernetes.io/projected/b9d15339-0974-4965-8663-684dadaa99db-kube-api-access-pq7pw\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:40.935788 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-textfile\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.935788 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.935788 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-root\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whxb9\" (UniqueName: \"kubernetes.io/projected/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-api-access-whxb9\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:40.935905    2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.935960    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-root\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:40.936001    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-tls podName:e5ae6b5d-49bc-4823-8284-5d253e0be2c4 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:41.435979795 +0000 UTC m=+83.436116581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-k9lpf" (UID: "e5ae6b5d-49bc-4823-8284-5d253e0be2c4") : secret "kube-state-metrics-tls" not found
Jul 02 19:06:40.936051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-wtmp\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-tls\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66391b02-53a4-4693-94d1-dce9e9cb08d0-metrics-client-ca\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6wb\" (UniqueName: \"kubernetes.io/projected/66391b02-53a4-4693-94d1-dce9e9cb08d0-kube-api-access-jq6wb\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:40.936292    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936361    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-wtmp\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:06:40.936366    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-tls podName:66391b02-53a4-4693-94d1-dce9e9cb08d0 nodeName:}" failed. No retries permitted until 2026-07-02 19:06:41.436350807 +0000 UTC m=+83.436487582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-tls") pod "node-exporter-8ccm7" (UID: "66391b02-53a4-4693-94d1-dce9e9cb08d0") : secret "node-exporter-tls" not found
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-sys\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.936513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.937111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936594    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.937111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66391b02-53a4-4693-94d1-dce9e9cb08d0-sys\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.937111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.936901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-textfile\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.937111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.937021    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66391b02-53a4-4693-94d1-dce9e9cb08d0-metrics-client-ca\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.937111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.937097    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-accelerators-collector-config\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.937576 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.937553    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.938773 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.938750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:40.938909 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.938890    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.949334 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.949309    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whxb9\" (UniqueName: \"kubernetes.io/projected/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-api-access-whxb9\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:40.950526 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:40.950504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6wb\" (UniqueName: \"kubernetes.io/projected/66391b02-53a4-4693-94d1-dce9e9cb08d0-kube-api-access-jq6wb\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:41.339892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.339855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:41.342631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.342578    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9d15339-0974-4965-8663-684dadaa99db-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dm7l2\" (UID: \"b9d15339-0974-4965-8663-684dadaa99db\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:41.440308 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.440268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:41.440490 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.440332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-tls\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:41.442531 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.442504    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66391b02-53a4-4693-94d1-dce9e9cb08d0-node-exporter-tls\") pod \"node-exporter-8ccm7\" (UID: \"66391b02-53a4-4693-94d1-dce9e9cb08d0\") " pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:41.442645 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.442614    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5ae6b5d-49bc-4823-8284-5d253e0be2c4-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-k9lpf\" (UID: \"e5ae6b5d-49bc-4823-8284-5d253e0be2c4\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:41.527291 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.527248    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"
Jul 02 19:06:41.567081 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.567046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8ccm7"
Jul 02 19:06:41.572651 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.572618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"
Jul 02 19:06:41.586061 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:41.586029    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66391b02_53a4_4693_94d1_dce9e9cb08d0.slice/crio-18300a305c6b7322871750f63f946e2ccbda3a73bfbb16159539b217ee43b59d WatchSource:0}: Error finding container 18300a305c6b7322871750f63f946e2ccbda3a73bfbb16159539b217ee43b59d: Status 404 returned error can't find the container with id 18300a305c6b7322871750f63f946e2ccbda3a73bfbb16159539b217ee43b59d
Jul 02 19:06:41.726282 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.726171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2"]
Jul 02 19:06:41.729442 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:41.729411    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d15339_0974_4965_8663_684dadaa99db.slice/crio-653859ee8d0efe593975fbb335edfc54cdd14f3ed57088f9260b6d200f909bce WatchSource:0}: Error finding container 653859ee8d0efe593975fbb335edfc54cdd14f3ed57088f9260b6d200f909bce: Status 404 returned error can't find the container with id 653859ee8d0efe593975fbb335edfc54cdd14f3ed57088f9260b6d200f909bce
Jul 02 19:06:41.754704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:41.754679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf"]
Jul 02 19:06:41.761373 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:41.761320    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ae6b5d_49bc_4823_8284_5d253e0be2c4.slice/crio-93d0fd5aee92023af546f854a4fa725a1f225abf7204ec932c4e951a5c748d10 WatchSource:0}: Error finding container 93d0fd5aee92023af546f854a4fa725a1f225abf7204ec932c4e951a5c748d10: Status 404 returned error can't find the container with id 93d0fd5aee92023af546f854a4fa725a1f225abf7204ec932c4e951a5c748d10
Jul 02 19:06:42.074570 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:42.074455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf" event={"ID":"e5ae6b5d-49bc-4823-8284-5d253e0be2c4","Type":"ContainerStarted","Data":"93d0fd5aee92023af546f854a4fa725a1f225abf7204ec932c4e951a5c748d10"}
Jul 02 19:06:42.075819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:42.075757    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ccm7" event={"ID":"66391b02-53a4-4693-94d1-dce9e9cb08d0","Type":"ContainerStarted","Data":"18300a305c6b7322871750f63f946e2ccbda3a73bfbb16159539b217ee43b59d"}
Jul 02 19:06:42.077977 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:42.077953    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2" event={"ID":"b9d15339-0974-4965-8663-684dadaa99db","Type":"ContainerStarted","Data":"cd6b2c5ecf9e20e519d2b7664cbc9167e4d9be8b3f9574e3d2c70818869bd60d"}
Jul 02 19:06:42.078075 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:42.077996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2" event={"ID":"b9d15339-0974-4965-8663-684dadaa99db","Type":"ContainerStarted","Data":"54b06fa4d91b61c03d41f633178aa175e175d4a4dcdb2eefe10602e8313f4655"}
Jul 02 19:06:42.078075 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:42.078014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2" event={"ID":"b9d15339-0974-4965-8663-684dadaa99db","Type":"ContainerStarted","Data":"653859ee8d0efe593975fbb335edfc54cdd14f3ed57088f9260b6d200f909bce"}
Jul 02 19:06:43.039054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.039017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5p2g6"
Jul 02 19:06:43.600687 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.600658    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cb898c6b6-twhjx"]
Jul 02 19:06:43.606307 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.606281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.609134 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609092    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 19:06:43.609269 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609114    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 19:06:43.609269 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609166    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 19:06:43.609269 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609097    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5edn5crofo575\""
Jul 02 19:06:43.609432 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609105    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 19:06:43.609432 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609096    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k99j2\""
Jul 02 19:06:43.609609 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.609593    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 19:06:43.616474 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.616407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cb898c6b6-twhjx"]
Jul 02 19:06:43.661017 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.660987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661040    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f4a51c-fb26-4804-b592-12b732b98a0c-metrics-client-ca\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-tls\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pljh2\" (UniqueName: \"kubernetes.io/projected/f8f4a51c-fb26-4804-b592-12b732b98a0c-kube-api-access-pljh2\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-grpc-tls\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.661209 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.661189    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763026 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.762982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f4a51c-fb26-4804-b592-12b732b98a0c-metrics-client-ca\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-tls\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pljh2\" (UniqueName: \"kubernetes.io/projected/f8f4a51c-fb26-4804-b592-12b732b98a0c-kube-api-access-pljh2\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763138    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-grpc-tls\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763509 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763509 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.763903 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.763792    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f4a51c-fb26-4804-b592-12b732b98a0c-metrics-client-ca\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.766474 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.766416    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.766474 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.766427    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.766650 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.766607    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.767232 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.767205    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-grpc-tls\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.767989 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.767960    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-tls\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.769180 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.769144    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8f4a51c-fb26-4804-b592-12b732b98a0c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.774861 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.774174    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pljh2\" (UniqueName: \"kubernetes.io/projected/f8f4a51c-fb26-4804-b592-12b732b98a0c-kube-api-access-pljh2\") pod \"thanos-querier-cb898c6b6-twhjx\" (UID: \"f8f4a51c-fb26-4804-b592-12b732b98a0c\") " pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:43.991539 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:43.991505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:44.094937 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.094436    2563 generic.go:356] "Generic (PLEG): container finished" podID="66391b02-53a4-4693-94d1-dce9e9cb08d0" containerID="e1b5ee4cb405b2c07676cde8618ff8ac6a46fa6372d4982c1d95518ad3dc2cac" exitCode=0
Jul 02 19:06:44.094937 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.094578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ccm7" event={"ID":"66391b02-53a4-4693-94d1-dce9e9cb08d0","Type":"ContainerDied","Data":"e1b5ee4cb405b2c07676cde8618ff8ac6a46fa6372d4982c1d95518ad3dc2cac"}
Jul 02 19:06:44.099635 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.099554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2" event={"ID":"b9d15339-0974-4965-8663-684dadaa99db","Type":"ContainerStarted","Data":"01c78e350b35f4efcd16fbf2ed28383f930e1d7c20e05aac6a827126f0417d15"}
Jul 02 19:06:44.105431 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.105381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf" event={"ID":"e5ae6b5d-49bc-4823-8284-5d253e0be2c4","Type":"ContainerStarted","Data":"9766ff1cd6cbc76e9eb188bce9ada32ecf91c6257a9fbf341519bba0709d893a"}
Jul 02 19:06:44.105534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.105441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf" event={"ID":"e5ae6b5d-49bc-4823-8284-5d253e0be2c4","Type":"ContainerStarted","Data":"b7474c3f341bd9e52b3753750b9bf15a6179679cb41f2f7cf1aacf55501ffbdc"}
Jul 02 19:06:44.105534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.105468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf" event={"ID":"e5ae6b5d-49bc-4823-8284-5d253e0be2c4","Type":"ContainerStarted","Data":"f511e544e91065835e8558848072fc42ec4d19313a676bc3314facbf1ad56b8f"}
Jul 02 19:06:44.130447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.129300    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-k9lpf" podStartSLOduration=2.3216971109999998 podStartE2EDuration="4.129279006s" totalImagesPullingTime="1.807581895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:44.128998486 +0000 UTC m=+86.129135281" watchObservedRunningTime="2026-07-02 19:06:44.129279006 +0000 UTC m=+86.129415781"
Jul 02 19:06:44.149584 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.149059    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dm7l2" podStartSLOduration=2.481498323 podStartE2EDuration="4.149039822s" totalImagesPullingTime="1.667541499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:44.146401372 +0000 UTC m=+86.146538166" watchObservedRunningTime="2026-07-02 19:06:44.149039822 +0000 UTC m=+86.149176621"
Jul 02 19:06:44.159229 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:44.158553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cb898c6b6-twhjx"]
Jul 02 19:06:44.165227 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:06:44.165178    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f4a51c_fb26_4804_b592_12b732b98a0c.slice/crio-30a316f89b8db02049c76dc959b9614aa3e7642833209e052af6379f86fdc898 WatchSource:0}: Error finding container 30a316f89b8db02049c76dc959b9614aa3e7642833209e052af6379f86fdc898: Status 404 returned error can't find the container with id 30a316f89b8db02049c76dc959b9614aa3e7642833209e052af6379f86fdc898
Jul 02 19:06:45.111828 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:45.111786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ccm7" event={"ID":"66391b02-53a4-4693-94d1-dce9e9cb08d0","Type":"ContainerStarted","Data":"0902e648be61bee43760babed8becea4c486029ec596510abc80d75f2742b892"}
Jul 02 19:06:45.112307 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:45.111857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8ccm7" event={"ID":"66391b02-53a4-4693-94d1-dce9e9cb08d0","Type":"ContainerStarted","Data":"d1aaf53dd50bfcdcb435cb2b1ca06dce6252f0d7771ee8c250cdcdd19e58e011"}
Jul 02 19:06:45.113163 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:45.113077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"30a316f89b8db02049c76dc959b9614aa3e7642833209e052af6379f86fdc898"}
Jul 02 19:06:45.130987 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:45.130935    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8ccm7" podStartSLOduration=3.048075737 podStartE2EDuration="5.130917058s" totalImagesPullingTime="1.979594997s" totalInitContainerRuntime="103.246324ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:45.129580337 +0000 UTC m=+87.129717132" watchObservedRunningTime="2026-07-02 19:06:45.130917058 +0000 UTC m=+87.131053853"
Jul 02 19:06:45.473365 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:45.473268    2563 patch_prober.go:28] interesting pod/image-registry-5dff8579d6-866sx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 19:06:45.473365 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:45.473327    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" podUID="4d60c55d-f32c-4989-82e5-578078c05efb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:06:46.998956 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:46.998926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:06:49.681399 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:49.681368    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dff8579d6-866sx"]
Jul 02 19:06:52.147426 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:52.147344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-jwkvq" event={"ID":"26c2c3e6-f544-489f-912e-982dbafffff5","Type":"ContainerStarted","Data":"97731a146e1b4c322855be40d77d7829e1b8ed0452f757b5860205ec701b3f89"}
Jul 02 19:06:52.147876 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:52.147684    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:52.149082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:52.149053    2563 patch_prober.go:28] interesting pod/downloads-685bfb5f64-jwkvq container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body=
Jul 02 19:06:52.149225 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:52.149094    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-jwkvq" podUID="26c2c3e6-f544-489f-912e-982dbafffff5" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused"
Jul 02 19:06:52.167711 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:52.167664    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-jwkvq" podStartSLOduration=1.3484853989999999 podStartE2EDuration="19.167644909s" totalImagesPullingTime="17.81915951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:52.167580028 +0000 UTC m=+94.167716836" watchObservedRunningTime="2026-07-02 19:06:52.167644909 +0000 UTC m=+94.167781702"
Jul 02 19:06:53.177596 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:53.177554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-jwkvq"
Jul 02 19:06:54.174167 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:54.174135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"ed14964869fe2e830c072de7fe573b131db3294466e981be74dd8e4fb2826154"}
Jul 02 19:06:54.174307 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:54.174244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"1042f2c04405ea8729d741dd703e12a1696fbceca514cec7ad6835ac53681b4e"}
Jul 02 19:06:55.182365 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:55.182329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"da202ebc0398cf7b7fa3a35d6959d75fa432d02289e8ab732f2c29475f4ff3fc"}
Jul 02 19:06:55.985167 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:55.985137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j5cz5"
Jul 02 19:06:56.191840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:56.191750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"ba0c9c25cf4dd6654a9981181ec4220c4e1dcdee6c69808b876d72267d8a5abb"}
Jul 02 19:06:56.191840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:56.191830    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"d8712580058ce01c60ae033f0035e0149cc762a6fce4a4212d679496f48cd3fc"}
Jul 02 19:06:56.192312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:56.191871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" event={"ID":"f8f4a51c-fb26-4804-b592-12b732b98a0c","Type":"ContainerStarted","Data":"7b37561e1a9860c465884dcb67517fe5d2c83b2ffabbf393d06a172c687857cd"}
Jul 02 19:06:56.192312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:56.191910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:06:56.213235 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:06:56.213164    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx" podStartSLOduration=2.266130493 podStartE2EDuration="13.213145159s" totalImagesPullingTime="10.947014666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:56.211961845 +0000 UTC m=+98.212098640" watchObservedRunningTime="2026-07-02 19:06:56.213145159 +0000 UTC m=+98.213281955"
Jul 02 19:07:02.203146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:02.203115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cb898c6b6-twhjx"
Jul 02 19:07:14.270829 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:14.270796    2563 generic.go:356] "Generic (PLEG): container finished" podID="a3d70706-f8d8-4cd0-8482-4014f647862d" containerID="eb0b51750697a19459e2b54c12fb55612e36d0fd934f883245fea1c80f3159c7" exitCode=0
Jul 02 19:07:14.271243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:14.270844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x" event={"ID":"a3d70706-f8d8-4cd0-8482-4014f647862d","Type":"ContainerDied","Data":"eb0b51750697a19459e2b54c12fb55612e36d0fd934f883245fea1c80f3159c7"}
Jul 02 19:07:14.271243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:14.271172    2563 scope.go:117] "RemoveContainer" containerID="eb0b51750697a19459e2b54c12fb55612e36d0fd934f883245fea1c80f3159c7"
Jul 02 19:07:14.704724 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:14.704624    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" podUID="4d60c55d-f32c-4989-82e5-578078c05efb" containerName="registry" containerID="cri-o://8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a" gracePeriod=30
Jul 02 19:07:14.970581 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:14.970524    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:07:15.033219 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033174    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033219 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d60c55d-f32c-4989-82e5-578078c05efb-ca-trust-extracted\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033246    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-trusted-ca\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-registry-certificates\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033336    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-installation-pull-secrets\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-image-registry-private-configuration\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033652 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033433    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jllpw\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-kube-api-access-jllpw\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033652 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033461    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-bound-sa-token\") pod \"4d60c55d-f32c-4989-82e5-578078c05efb\" (UID: \"4d60c55d-f32c-4989-82e5-578078c05efb\") "
Jul 02 19:07:15.033765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033733    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:15.033825 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.033742    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:07:15.036022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.035990    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:15.036022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.036034    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-kube-api-access-jllpw" (OuterVolumeSpecName: "kube-api-access-jllpw") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "kube-api-access-jllpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:07:15.036190 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.036108    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:07:15.036190 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.036158    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:07:15.036376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.036358    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:07:15.042330 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.042309    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d60c55d-f32c-4989-82e5-578078c05efb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4d60c55d-f32c-4989-82e5-578078c05efb" (UID: "4d60c55d-f32c-4989-82e5-578078c05efb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:07:15.134527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134495    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-image-registry-private-configuration\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134521    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jllpw\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-kube-api-access-jllpw\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134531    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-bound-sa-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134540    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d60c55d-f32c-4989-82e5-578078c05efb-registry-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134548    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d60c55d-f32c-4989-82e5-578078c05efb-ca-trust-extracted\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134555    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-trusted-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134563    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d60c55d-f32c-4989-82e5-578078c05efb-registry-certificates\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.134732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.134571    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d60c55d-f32c-4989-82e5-578078c05efb-installation-pull-secrets\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:07:15.276934 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.276900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rn49x" event={"ID":"a3d70706-f8d8-4cd0-8482-4014f647862d","Type":"ContainerStarted","Data":"b06961b20d74080e817950470f2980f2c61273fb6cacd4f96a3fcb214edb041d"}
Jul 02 19:07:15.278053 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.278031    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d60c55d-f32c-4989-82e5-578078c05efb" containerID="8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a" exitCode=0
Jul 02 19:07:15.278157 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.278064    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dff8579d6-866sx"
Jul 02 19:07:15.278157 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.278094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" event={"ID":"4d60c55d-f32c-4989-82e5-578078c05efb","Type":"ContainerDied","Data":"8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a"}
Jul 02 19:07:15.278157 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.278125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dff8579d6-866sx" event={"ID":"4d60c55d-f32c-4989-82e5-578078c05efb","Type":"ContainerDied","Data":"9ad7e4a7b77c756e9f63a56006760f2ecec79e172e68b43a60f4feeb058808f0"}
Jul 02 19:07:15.278157 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.278143    2563 scope.go:117] "RemoveContainer" containerID="8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a"
Jul 02 19:07:15.286763 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.286747    2563 scope.go:117] "RemoveContainer" containerID="8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a"
Jul 02 19:07:15.287001 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:07:15.286979    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a\": container with ID starting with 8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a not found: ID does not exist" containerID="8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a"
Jul 02 19:07:15.287051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.287013    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a"} err="failed to get container status \"8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a\": rpc error: code = NotFound desc = could not find container \"8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a\": container with ID starting with 8852b503a43c0536025862772f9af314f2c905ac912f1d3abc5218cc366eea8a not found: ID does not exist"
Jul 02 19:07:15.312049 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.312013    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dff8579d6-866sx"]
Jul 02 19:07:15.315554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:15.315530    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dff8579d6-866sx"]
Jul 02 19:07:16.494981 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:16.494943    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d60c55d-f32c-4989-82e5-578078c05efb" path="/var/lib/kubelet/pods/4d60c55d-f32c-4989-82e5-578078c05efb/volumes"
Jul 02 19:07:19.295610 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:19.295576    2563 generic.go:356] "Generic (PLEG): container finished" podID="f103cdb0-1039-4f92-8b6b-d3d4dadba1af" containerID="95131c111f015e6b9f3f453d291d5804a1327129cc7221bb692690f0b005e53a" exitCode=0
Jul 02 19:07:19.296031 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:19.295649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7" event={"ID":"f103cdb0-1039-4f92-8b6b-d3d4dadba1af","Type":"ContainerDied","Data":"95131c111f015e6b9f3f453d291d5804a1327129cc7221bb692690f0b005e53a"}
Jul 02 19:07:19.296031 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:19.295955    2563 scope.go:117] "RemoveContainer" containerID="95131c111f015e6b9f3f453d291d5804a1327129cc7221bb692690f0b005e53a"
Jul 02 19:07:20.305974 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:20.305939    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-sfxl7" event={"ID":"f103cdb0-1039-4f92-8b6b-d3d4dadba1af","Type":"ContainerStarted","Data":"80162aa9968361498410a8066026aa01c7f4cc7ddaad5ad7a70976ea1073ba8a"}
Jul 02 19:07:24.322805 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:24.322772    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ce04143-9907-44b1-bffa-8f9ca68d7cce" containerID="3f249e011606df1509917388f95fc16dd391de177366639551228e5f017d57ea" exitCode=0
Jul 02 19:07:24.323264 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:24.322846    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw" event={"ID":"2ce04143-9907-44b1-bffa-8f9ca68d7cce","Type":"ContainerDied","Data":"3f249e011606df1509917388f95fc16dd391de177366639551228e5f017d57ea"}
Jul 02 19:07:24.323264 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:24.323169    2563 scope.go:117] "RemoveContainer" containerID="3f249e011606df1509917388f95fc16dd391de177366639551228e5f017d57ea"
Jul 02 19:07:25.328154 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:07:25.328121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-r4bzw" event={"ID":"2ce04143-9907-44b1-bffa-8f9ca68d7cce","Type":"ContainerStarted","Data":"678f4cd15c526e25adddfc6198af15c1f8146447e9accc7c8da5ddd196580bd4"}
Jul 02 19:10:18.327101 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:18.327071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:10:18.330623 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:18.330603    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:10:18.334218 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:18.334183    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:10:18.337827 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:18.337809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:10:18.339146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:18.339104    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:10:52.424142 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.424109    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"]
Jul 02 19:10:52.426526 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.424492    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d60c55d-f32c-4989-82e5-578078c05efb" containerName="registry"
Jul 02 19:10:52.426526 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.424503    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d60c55d-f32c-4989-82e5-578078c05efb" containerName="registry"
Jul 02 19:10:52.426526 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.424563    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d60c55d-f32c-4989-82e5-578078c05efb" containerName="registry"
Jul 02 19:10:52.427518 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.427503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.430703 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.430684    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 02 19:10:52.430832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.430739    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 02 19:10:52.430832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.430815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tnws7\""
Jul 02 19:10:52.448698 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.448673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"]
Jul 02 19:10:52.534418 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.534393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcmmr\" (UniqueName: \"kubernetes.io/projected/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-kube-api-access-kcmmr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.534543 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.534424    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.534543 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.534444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.635624 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.635587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcmmr\" (UniqueName: \"kubernetes.io/projected/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-kube-api-access-kcmmr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.635624 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.635626    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.635879 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.635644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.636063 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.636045    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.636107 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.636045    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.643467 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.643437    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcmmr\" (UniqueName: \"kubernetes.io/projected/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-kube-api-access-kcmmr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.736265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.736191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:10:52.865580 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.865551    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"]
Jul 02 19:10:52.868108 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:10:52.868082    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c3d7c3_133f_4abf_a2ec_bfa71caf9846.slice/crio-652f5a1be1f456076acbc46bd9e4090999a1bef2c2dffe932b97ca718fad3e2c WatchSource:0}: Error finding container 652f5a1be1f456076acbc46bd9e4090999a1bef2c2dffe932b97ca718fad3e2c: Status 404 returned error can't find the container with id 652f5a1be1f456076acbc46bd9e4090999a1bef2c2dffe932b97ca718fad3e2c
Jul 02 19:10:52.870053 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:52.870038    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:10:53.134689 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:53.134660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz" event={"ID":"64c3d7c3-133f-4abf-a2ec-bfa71caf9846","Type":"ContainerStarted","Data":"652f5a1be1f456076acbc46bd9e4090999a1bef2c2dffe932b97ca718fad3e2c"}
Jul 02 19:10:55.179721 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.179679    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d489f"]
Jul 02 19:10:55.182862 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.182846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.185111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.185085    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 19:10:55.185266 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.185227    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 19:10:55.185266 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.185250    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ldsmk\""
Jul 02 19:10:55.190388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.190368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d489f"]
Jul 02 19:10:55.355571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.355535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4d5fe57-85f1-4240-8d74-24db413eeec9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d489f\" (UID: \"c4d5fe57-85f1-4240-8d74-24db413eeec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.355737 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.355587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4zrm\" (UniqueName: \"kubernetes.io/projected/c4d5fe57-85f1-4240-8d74-24db413eeec9-kube-api-access-b4zrm\") pod \"cert-manager-cainjector-559cdd8c87-d489f\" (UID: \"c4d5fe57-85f1-4240-8d74-24db413eeec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.456635 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.456529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4d5fe57-85f1-4240-8d74-24db413eeec9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d489f\" (UID: \"c4d5fe57-85f1-4240-8d74-24db413eeec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.456635 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.456611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4zrm\" (UniqueName: \"kubernetes.io/projected/c4d5fe57-85f1-4240-8d74-24db413eeec9-kube-api-access-b4zrm\") pod \"cert-manager-cainjector-559cdd8c87-d489f\" (UID: \"c4d5fe57-85f1-4240-8d74-24db413eeec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.470245 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.470218    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4d5fe57-85f1-4240-8d74-24db413eeec9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d489f\" (UID: \"c4d5fe57-85f1-4240-8d74-24db413eeec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.470382 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.470328    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4zrm\" (UniqueName: \"kubernetes.io/projected/c4d5fe57-85f1-4240-8d74-24db413eeec9-kube-api-access-b4zrm\") pod \"cert-manager-cainjector-559cdd8c87-d489f\" (UID: \"c4d5fe57-85f1-4240-8d74-24db413eeec9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.504277 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.504251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f"
Jul 02 19:10:55.645159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:55.645108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d489f"]
Jul 02 19:10:55.647589 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:10:55.647558    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4d5fe57_85f1_4240_8d74_24db413eeec9.slice/crio-68a579cea255d1a3f990e618414703e711c6f25ef9d55bb4bd25a2123e7d71a9 WatchSource:0}: Error finding container 68a579cea255d1a3f990e618414703e711c6f25ef9d55bb4bd25a2123e7d71a9: Status 404 returned error can't find the container with id 68a579cea255d1a3f990e618414703e711c6f25ef9d55bb4bd25a2123e7d71a9
Jul 02 19:10:56.146965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:10:56.146917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f" event={"ID":"c4d5fe57-85f1-4240-8d74-24db413eeec9","Type":"ContainerStarted","Data":"68a579cea255d1a3f990e618414703e711c6f25ef9d55bb4bd25a2123e7d71a9"}
Jul 02 19:11:01.173430 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:01.173392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f" event={"ID":"c4d5fe57-85f1-4240-8d74-24db413eeec9","Type":"ContainerStarted","Data":"f372a9221f11ac98cc680e805d54b5cd4b32fcee233e3a4b375b2a1558d3782d"}
Jul 02 19:11:01.174926 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:01.174901    2563 generic.go:356] "Generic (PLEG): container finished" podID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerID="2d84de3102be61bd02e22ca9246f3c65aca43d859132b5763d8e3f528a4dbb18" exitCode=0
Jul 02 19:11:01.175037 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:01.174959    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz" event={"ID":"64c3d7c3-133f-4abf-a2ec-bfa71caf9846","Type":"ContainerDied","Data":"2d84de3102be61bd02e22ca9246f3c65aca43d859132b5763d8e3f528a4dbb18"}
Jul 02 19:11:01.208850 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:01.208798    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d489f" podStartSLOduration=1.270385671 podStartE2EDuration="6.208780001s" totalImagesPullingTime="4.93839433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:01.207593469 +0000 UTC m=+343.207730262" watchObservedRunningTime="2026-07-02 19:11:01.208780001 +0000 UTC m=+343.208916797"
Jul 02 19:11:04.190526 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:04.190472    2563 generic.go:356] "Generic (PLEG): container finished" podID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerID="3d95d9a4942ce87796e983dfae5a7f364e1fe96d2dfbc42aa12368b24d3bc6a2" exitCode=0
Jul 02 19:11:04.190973 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:04.190577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz" event={"ID":"64c3d7c3-133f-4abf-a2ec-bfa71caf9846","Type":"ContainerDied","Data":"3d95d9a4942ce87796e983dfae5a7f364e1fe96d2dfbc42aa12368b24d3bc6a2"}
Jul 02 19:11:05.278083 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.278048    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ddsmd"]
Jul 02 19:11:05.281379 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.281363    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.283549 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.283530    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gdh7l\""
Jul 02 19:11:05.291588 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.291567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ddsmd"]
Jul 02 19:11:05.347256 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.347228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcjhn\" (UniqueName: \"kubernetes.io/projected/99bc8866-1eca-4d94-9850-c89cddb3117a-kube-api-access-fcjhn\") pod \"cert-manager-55b4d954d5-ddsmd\" (UID: \"99bc8866-1eca-4d94-9850-c89cddb3117a\") " pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.347451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.347279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99bc8866-1eca-4d94-9850-c89cddb3117a-bound-sa-token\") pod \"cert-manager-55b4d954d5-ddsmd\" (UID: \"99bc8866-1eca-4d94-9850-c89cddb3117a\") " pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.448111 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.448073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcjhn\" (UniqueName: \"kubernetes.io/projected/99bc8866-1eca-4d94-9850-c89cddb3117a-kube-api-access-fcjhn\") pod \"cert-manager-55b4d954d5-ddsmd\" (UID: \"99bc8866-1eca-4d94-9850-c89cddb3117a\") " pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.448297 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.448122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99bc8866-1eca-4d94-9850-c89cddb3117a-bound-sa-token\") pod \"cert-manager-55b4d954d5-ddsmd\" (UID: \"99bc8866-1eca-4d94-9850-c89cddb3117a\") " pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.456551 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.456526    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99bc8866-1eca-4d94-9850-c89cddb3117a-bound-sa-token\") pod \"cert-manager-55b4d954d5-ddsmd\" (UID: \"99bc8866-1eca-4d94-9850-c89cddb3117a\") " pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.456729 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.456709    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcjhn\" (UniqueName: \"kubernetes.io/projected/99bc8866-1eca-4d94-9850-c89cddb3117a-kube-api-access-fcjhn\") pod \"cert-manager-55b4d954d5-ddsmd\" (UID: \"99bc8866-1eca-4d94-9850-c89cddb3117a\") " pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.590641 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.590568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ddsmd"
Jul 02 19:11:05.724933 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:05.724903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ddsmd"]
Jul 02 19:11:05.727721 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:11:05.727697    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99bc8866_1eca_4d94_9850_c89cddb3117a.slice/crio-08ad5ebcf47a7a2d37a53707d43c0f1b561b3b30679461973ddbc838bde4d1de WatchSource:0}: Error finding container 08ad5ebcf47a7a2d37a53707d43c0f1b561b3b30679461973ddbc838bde4d1de: Status 404 returned error can't find the container with id 08ad5ebcf47a7a2d37a53707d43c0f1b561b3b30679461973ddbc838bde4d1de
Jul 02 19:11:06.202754 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:06.202720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ddsmd" event={"ID":"99bc8866-1eca-4d94-9850-c89cddb3117a","Type":"ContainerStarted","Data":"43bfe180b28bc56ac58aed2d03a2456aab7f0613491b8a33c3eb913b43f577f2"}
Jul 02 19:11:06.202966 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:06.202763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ddsmd" event={"ID":"99bc8866-1eca-4d94-9850-c89cddb3117a","Type":"ContainerStarted","Data":"08ad5ebcf47a7a2d37a53707d43c0f1b561b3b30679461973ddbc838bde4d1de"}
Jul 02 19:11:06.220398 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:06.220340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ddsmd" podStartSLOduration=1.220320755 podStartE2EDuration="1.220320755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:06.218480278 +0000 UTC m=+348.218617064" watchObservedRunningTime="2026-07-02 19:11:06.220320755 +0000 UTC m=+348.220457549"
Jul 02 19:11:13.235574 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:13.235539    2563 generic.go:356] "Generic (PLEG): container finished" podID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerID="826943bd54eed12a14a3364057c2cd53a58cc6fef700056e39e53944d2cf181e" exitCode=0
Jul 02 19:11:13.236014 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:13.235609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz" event={"ID":"64c3d7c3-133f-4abf-a2ec-bfa71caf9846","Type":"ContainerDied","Data":"826943bd54eed12a14a3364057c2cd53a58cc6fef700056e39e53944d2cf181e"}
Jul 02 19:11:14.372770 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.372744    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:11:14.425945 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.425917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcmmr\" (UniqueName: \"kubernetes.io/projected/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-kube-api-access-kcmmr\") pod \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") "
Jul 02 19:11:14.426116 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.425957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-bundle\") pod \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") "
Jul 02 19:11:14.426184 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.426108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-util\") pod \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\" (UID: \"64c3d7c3-133f-4abf-a2ec-bfa71caf9846\") "
Jul 02 19:11:14.426427 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.426327    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-bundle" (OuterVolumeSpecName: "bundle") pod "64c3d7c3-133f-4abf-a2ec-bfa71caf9846" (UID: "64c3d7c3-133f-4abf-a2ec-bfa71caf9846"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:11:14.428296 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.428270    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-kube-api-access-kcmmr" (OuterVolumeSpecName: "kube-api-access-kcmmr") pod "64c3d7c3-133f-4abf-a2ec-bfa71caf9846" (UID: "64c3d7c3-133f-4abf-a2ec-bfa71caf9846"). InnerVolumeSpecName "kube-api-access-kcmmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:11:14.430245 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.430220    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-util" (OuterVolumeSpecName: "util") pod "64c3d7c3-133f-4abf-a2ec-bfa71caf9846" (UID: "64c3d7c3-133f-4abf-a2ec-bfa71caf9846"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:11:14.527575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.527552    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-util\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:11:14.527575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.527574    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcmmr\" (UniqueName: \"kubernetes.io/projected/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-kube-api-access-kcmmr\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:11:14.527721 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:14.527586    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64c3d7c3-133f-4abf-a2ec-bfa71caf9846-bundle\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:11:15.245880 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:15.245848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz" event={"ID":"64c3d7c3-133f-4abf-a2ec-bfa71caf9846","Type":"ContainerDied","Data":"652f5a1be1f456076acbc46bd9e4090999a1bef2c2dffe932b97ca718fad3e2c"}
Jul 02 19:11:15.246081 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:15.245900    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="652f5a1be1f456076acbc46bd9e4090999a1bef2c2dffe932b97ca718fad3e2c"
Jul 02 19:11:15.246081 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:15.245899    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f75bxz"
Jul 02 19:11:34.678616 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.678581    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"]
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679057    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="extract"
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679075    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="extract"
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679092    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="util"
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679100    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="util"
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679114    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="pull"
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679122    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="pull"
Jul 02 19:11:34.679252 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.679250    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64c3d7c3-133f-4abf-a2ec-bfa71caf9846" containerName="extract"
Jul 02 19:11:34.683354 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.683333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.689489 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.689467    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 19:11:34.689608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.689498    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:11:34.690354 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.690329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 19:11:34.690467 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.690336    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-snvkg\""
Jul 02 19:11:34.690532 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.690481    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:11:34.690638 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.690617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 19:11:34.700879 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.700860    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"]
Jul 02 19:11:34.799363 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.799327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-manager-config\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.799538 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.799388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhcsn\" (UniqueName: \"kubernetes.io/projected/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-kube-api-access-vhcsn\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.799538 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.799421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-metrics-cert\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.799538 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.799483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-cert\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.900400 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.900364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-metrics-cert\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.900586 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.900419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-cert\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.900586 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.900457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-manager-config\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.900586 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.900483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhcsn\" (UniqueName: \"kubernetes.io/projected/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-kube-api-access-vhcsn\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.901300 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.901274    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-manager-config\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.903016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.902996    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-cert\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.903357 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.903336    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-metrics-cert\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.909455 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.909434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhcsn\" (UniqueName: \"kubernetes.io/projected/64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8-kube-api-access-vhcsn\") pod \"lws-controller-manager-5556b8b6b-fwgkh\" (UID: \"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8\") " pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:34.998543 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:34.998466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:35.141704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:35.141680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"]
Jul 02 19:11:35.144295 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:11:35.144257    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e9bc2f_705f_4dcf_b1e2_72b6f6a5cfb8.slice/crio-0e82e6531e2fe12bd72eb34ca917fdd31c665609fee4fb601f3eb976ce62657d WatchSource:0}: Error finding container 0e82e6531e2fe12bd72eb34ca917fdd31c665609fee4fb601f3eb976ce62657d: Status 404 returned error can't find the container with id 0e82e6531e2fe12bd72eb34ca917fdd31c665609fee4fb601f3eb976ce62657d
Jul 02 19:11:35.327455 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:35.327422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh" event={"ID":"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8","Type":"ContainerStarted","Data":"0e82e6531e2fe12bd72eb34ca917fdd31c665609fee4fb601f3eb976ce62657d"}
Jul 02 19:11:37.340275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:37.340234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh" event={"ID":"64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8","Type":"ContainerStarted","Data":"ab8d616982f45ea0bf3709327747d79f1ee9f404819a01f9b0e3b22038c5bd9d"}
Jul 02 19:11:37.340686 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:37.340349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:37.361351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:37.361305    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh" podStartSLOduration=1.9691347129999999 podStartE2EDuration="3.361291815s" totalImagesPullingTime="1.392157102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:37.359149143 +0000 UTC m=+379.359285936" watchObservedRunningTime="2026-07-02 19:11:37.361291815 +0000 UTC m=+379.361428607"
Jul 02 19:11:45.742067 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.742029    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"]
Jul 02 19:11:45.759526 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.759501    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.763250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.763223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:11:45.763583 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.763546    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:11:45.764212 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.764175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:11:45.764321 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.764246    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:11:45.765126 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.765105    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nmldj\""
Jul 02 19:11:45.768379 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.768355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"]
Jul 02 19:11:45.787752 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.787727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6q6r\" (UniqueName: \"kubernetes.io/projected/936b1119-b522-48db-939a-ae3c9faefdbf-kube-api-access-b6q6r\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.787870 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.787768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/936b1119-b522-48db-939a-ae3c9faefdbf-tmp\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.787870 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.787802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/936b1119-b522-48db-939a-ae3c9faefdbf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.787989 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.787915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/936b1119-b522-48db-939a-ae3c9faefdbf-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.787989 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.787941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/936b1119-b522-48db-939a-ae3c9faefdbf-manifests\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.888484 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.888450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6q6r\" (UniqueName: \"kubernetes.io/projected/936b1119-b522-48db-939a-ae3c9faefdbf-kube-api-access-b6q6r\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.888484 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.888485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/936b1119-b522-48db-939a-ae3c9faefdbf-tmp\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.888724 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.888508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/936b1119-b522-48db-939a-ae3c9faefdbf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.888724 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.888555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/936b1119-b522-48db-939a-ae3c9faefdbf-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.888826 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.888752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/936b1119-b522-48db-939a-ae3c9faefdbf-manifests\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.889128 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.889099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/936b1119-b522-48db-939a-ae3c9faefdbf-manifests\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.890690 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.890670    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/936b1119-b522-48db-939a-ae3c9faefdbf-tmp\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.890899 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.890881    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/936b1119-b522-48db-939a-ae3c9faefdbf-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.890970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.890953    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/936b1119-b522-48db-939a-ae3c9faefdbf-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:45.904007 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:45.903986    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6q6r\" (UniqueName: \"kubernetes.io/projected/936b1119-b522-48db-939a-ae3c9faefdbf-kube-api-access-b6q6r\") pod \"opendatahub-operator-controller-manager-6cf784d988-8h7df\" (UID: \"936b1119-b522-48db-939a-ae3c9faefdbf\") " pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:46.078299 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:46.078273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:46.243494 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:46.243458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"]
Jul 02 19:11:46.247437 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:11:46.247410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936b1119_b522_48db_939a_ae3c9faefdbf.slice/crio-a8995e1820f130986633f48d6e57da431145ab89665951b036e8a109dc17a622 WatchSource:0}: Error finding container a8995e1820f130986633f48d6e57da431145ab89665951b036e8a109dc17a622: Status 404 returned error can't find the container with id a8995e1820f130986633f48d6e57da431145ab89665951b036e8a109dc17a622
Jul 02 19:11:46.380503 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:46.380417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df" event={"ID":"936b1119-b522-48db-939a-ae3c9faefdbf","Type":"ContainerStarted","Data":"a8995e1820f130986633f48d6e57da431145ab89665951b036e8a109dc17a622"}
Jul 02 19:11:48.346451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:48.346424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5556b8b6b-fwgkh"
Jul 02 19:11:50.403928 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:50.403892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df" event={"ID":"936b1119-b522-48db-939a-ae3c9faefdbf","Type":"ContainerStarted","Data":"1462640f6bf3e10fc530aa857d0051d3e6317d2ddee2ced9c51ee49acad24c8b"}
Jul 02 19:11:51.410155 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:51.410118    2563 generic.go:356] "Generic (PLEG): container finished" podID="936b1119-b522-48db-939a-ae3c9faefdbf" containerID="1462640f6bf3e10fc530aa857d0051d3e6317d2ddee2ced9c51ee49acad24c8b" exitCode=0
Jul 02 19:11:51.410568 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:51.410234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df" event={"ID":"936b1119-b522-48db-939a-ae3c9faefdbf","Type":"ContainerDied","Data":"1462640f6bf3e10fc530aa857d0051d3e6317d2ddee2ced9c51ee49acad24c8b"}
Jul 02 19:11:52.416668 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:52.416632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df" event={"ID":"936b1119-b522-48db-939a-ae3c9faefdbf","Type":"ContainerStarted","Data":"feb161784b6b1abb36db6a94ba3819ad8b566f0565a89abb3256f2806849c523"}
Jul 02 19:11:52.417095 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:52.416765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:11:52.437935 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:11:52.437894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df" podStartSLOduration=2.816398257 podStartE2EDuration="7.437878377s" totalImagesPullingTime="3.537968674s" totalInitContainerRuntime="1.083511446s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:52.436854077 +0000 UTC m=+394.436990871" watchObservedRunningTime="2026-07-02 19:11:52.437878377 +0000 UTC m=+394.438015168"
Jul 02 19:12:03.424140 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:03.424110    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cf784d988-8h7df"
Jul 02 19:12:15.922656 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.922627    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"]
Jul 02 19:12:15.926174 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.926151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:15.928796 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.928776    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 19:12:15.929152 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.929138    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m92gf\""
Jul 02 19:12:15.929301 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.929285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 19:12:15.929554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.929541    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 19:12:15.929913 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.929899    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 19:12:15.946376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:15.946353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"]
Jul 02 19:12:16.037409 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.037409 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.037409 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.037674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.037674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.037674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9f7b\" (UniqueName: \"kubernetes.io/projected/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-kube-api-access-b9f7b\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.037674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.037544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.138705 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.138662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.138705 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.138708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.138988 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.138732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.138988 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.138908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9f7b\" (UniqueName: \"kubernetes.io/projected/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-kube-api-access-b9f7b\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.138988 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.138955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.139144 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.139017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.139144 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.139047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.139424 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.139402    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.141185 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.141165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.141319 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.141245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.141390 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.141368    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.141448 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.141373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.151265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.151243    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9f7b\" (UniqueName: \"kubernetes.io/projected/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-kube-api-access-b9f7b\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.155490 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.155468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f103ca9f-e594-46f5-8c88-d6b50f6fcf69-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mptwx\" (UID: \"f103ca9f-e594-46f5-8c88-d6b50f6fcf69\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.235688 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.235537    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:16.396712 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.396668    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"]
Jul 02 19:12:16.525087 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:16.525048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx" event={"ID":"f103ca9f-e594-46f5-8c88-d6b50f6fcf69","Type":"ContainerStarted","Data":"d2abce9b35039582d70a4034f691eb44ddf6d17ac684674d0b4982714210d39c"}
Jul 02 19:12:19.190904 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:19.190863    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:12:19.191184 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:19.190943    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:12:19.541738 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:19.541703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx" event={"ID":"f103ca9f-e594-46f5-8c88-d6b50f6fcf69","Type":"ContainerStarted","Data":"9d874cc1ddf8b8e5c14f43302af3df2adce0c94618a7f9e6560185e6371e9a12"}
Jul 02 19:12:19.541943 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:19.541767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:12:19.566035 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:19.565982    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx" podStartSLOduration=1.780366787 podStartE2EDuration="4.565967722s" totalImagesPullingTime="2.785600935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:19.563059791 +0000 UTC m=+421.563196600" watchObservedRunningTime="2026-07-02 19:12:19.565967722 +0000 UTC m=+421.566104513"
Jul 02 19:12:20.547882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:12:20.547854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mptwx"
Jul 02 19:13:19.312039 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.312002    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"]
Jul 02 19:13:19.315581 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.315563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.318132 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.318109    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:13:19.318277 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.318163    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2chrd\""
Jul 02 19:13:19.318440 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.318405    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:13:19.319362 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.319338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"]
Jul 02 19:13:19.461132 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.461105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.461312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.461144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.461312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.461182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkg2l\" (UniqueName: \"kubernetes.io/projected/64158035-4456-4a68-a411-afabda9c717c-kube-api-access-fkg2l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.562146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.562070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkg2l\" (UniqueName: \"kubernetes.io/projected/64158035-4456-4a68-a411-afabda9c717c-kube-api-access-fkg2l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.562146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.562122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.562380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.562153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.562577 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.562554    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.562613 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.562564    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.569976 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.569953    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkg2l\" (UniqueName: \"kubernetes.io/projected/64158035-4456-4a68-a411-afabda9c717c-kube-api-access-fkg2l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.626955 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.626926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:19.754649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.754617    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"]
Jul 02 19:13:19.758294 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:13:19.758260    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64158035_4456_4a68_a411_afabda9c717c.slice/crio-14bf7348f2e6f4a782fe95de4cbcc96b2aa48d8b85982f23a18d471f3e1330b0 WatchSource:0}: Error finding container 14bf7348f2e6f4a782fe95de4cbcc96b2aa48d8b85982f23a18d471f3e1330b0: Status 404 returned error can't find the container with id 14bf7348f2e6f4a782fe95de4cbcc96b2aa48d8b85982f23a18d471f3e1330b0
Jul 02 19:13:19.815931 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.815867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4" event={"ID":"64158035-4456-4a68-a411-afabda9c717c","Type":"ContainerStarted","Data":"14bf7348f2e6f4a782fe95de4cbcc96b2aa48d8b85982f23a18d471f3e1330b0"}
Jul 02 19:13:19.897284 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.897252    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"]
Jul 02 19:13:19.900741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.900726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:19.907895 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.907871    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"]
Jul 02 19:13:19.965244 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.965219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:19.965383 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.965362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbnt\" (UniqueName: \"kubernetes.io/projected/aaf40b87-5bfe-4348-8908-29e579b0b0e3-kube-api-access-kmbnt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:19.965439 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:19.965416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.066557 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.066487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.066681 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.066556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbnt\" (UniqueName: \"kubernetes.io/projected/aaf40b87-5bfe-4348-8908-29e579b0b0e3-kube-api-access-kmbnt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.066681 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.066582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.066882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.066864    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.066934 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.066915    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.074466 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.074435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbnt\" (UniqueName: \"kubernetes.io/projected/aaf40b87-5bfe-4348-8908-29e579b0b0e3-kube-api-access-kmbnt\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.230754 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.230725    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:20.360635 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.360553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"]
Jul 02 19:13:20.363006 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:13:20.362983    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf40b87_5bfe_4348_8908_29e579b0b0e3.slice/crio-04f751607960c48fb5f33a0ac89e4c0cedfa628c9117300cc3b1a3b93b49ea4c WatchSource:0}: Error finding container 04f751607960c48fb5f33a0ac89e4c0cedfa628c9117300cc3b1a3b93b49ea4c: Status 404 returned error can't find the container with id 04f751607960c48fb5f33a0ac89e4c0cedfa628c9117300cc3b1a3b93b49ea4c
Jul 02 19:13:20.495937 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.495911    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"]
Jul 02 19:13:20.499287 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.499272    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.505323 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.505302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"]
Jul 02 19:13:20.571339 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.571305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.571442 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.571385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6jlm\" (UniqueName: \"kubernetes.io/projected/3adc51d2-0726-4272-9526-bee8ce4eba92-kube-api-access-j6jlm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.571442 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.571414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.672489 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.672422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6jlm\" (UniqueName: \"kubernetes.io/projected/3adc51d2-0726-4272-9526-bee8ce4eba92-kube-api-access-j6jlm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.672489 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.672463    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.672684 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.672496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.672854 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.672833    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.672920 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.672876    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.680506 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.680483    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6jlm\" (UniqueName: \"kubernetes.io/projected/3adc51d2-0726-4272-9526-bee8ce4eba92-kube-api-access-j6jlm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.822979 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.822947    2563 generic.go:356] "Generic (PLEG): container finished" podID="64158035-4456-4a68-a411-afabda9c717c" containerID="c792a899be1b6fbb7452387ca25232b08728de3dd5aa8d21bb3af22e841901cb" exitCode=0
Jul 02 19:13:20.823122 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.823033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4" event={"ID":"64158035-4456-4a68-a411-afabda9c717c","Type":"ContainerDied","Data":"c792a899be1b6fbb7452387ca25232b08728de3dd5aa8d21bb3af22e841901cb"}
Jul 02 19:13:20.824667 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.824617    2563 generic.go:356] "Generic (PLEG): container finished" podID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerID="ed1d4ccee949b161e2b462c629e080561f4f81686849bd4c228c830386c3d3cb" exitCode=0
Jul 02 19:13:20.824773 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.824684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh" event={"ID":"aaf40b87-5bfe-4348-8908-29e579b0b0e3","Type":"ContainerDied","Data":"ed1d4ccee949b161e2b462c629e080561f4f81686849bd4c228c830386c3d3cb"}
Jul 02 19:13:20.824773 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.824721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh" event={"ID":"aaf40b87-5bfe-4348-8908-29e579b0b0e3","Type":"ContainerStarted","Data":"04f751607960c48fb5f33a0ac89e4c0cedfa628c9117300cc3b1a3b93b49ea4c"}
Jul 02 19:13:20.830289 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.830269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:20.955720 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:20.955694    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"]
Jul 02 19:13:20.957121 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:13:20.957090    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adc51d2_0726_4272_9526_bee8ce4eba92.slice/crio-74de23e3181f041361da3ae7abe2abf5d0ed02a409068df8d520bd086e1c0f4c WatchSource:0}: Error finding container 74de23e3181f041361da3ae7abe2abf5d0ed02a409068df8d520bd086e1c0f4c: Status 404 returned error can't find the container with id 74de23e3181f041361da3ae7abe2abf5d0ed02a409068df8d520bd086e1c0f4c
Jul 02 19:13:21.833739 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.833705    2563 generic.go:356] "Generic (PLEG): container finished" podID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerID="a8c91336e8fe749bdb5150bb522091cacb2e25d7377ee3553cd3539cfdae406d" exitCode=0
Jul 02 19:13:21.834174 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.833797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv" event={"ID":"3adc51d2-0726-4272-9526-bee8ce4eba92","Type":"ContainerDied","Data":"a8c91336e8fe749bdb5150bb522091cacb2e25d7377ee3553cd3539cfdae406d"}
Jul 02 19:13:21.834174 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.833892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv" event={"ID":"3adc51d2-0726-4272-9526-bee8ce4eba92","Type":"ContainerStarted","Data":"74de23e3181f041361da3ae7abe2abf5d0ed02a409068df8d520bd086e1c0f4c"}
Jul 02 19:13:21.835844 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.835823    2563 generic.go:356] "Generic (PLEG): container finished" podID="64158035-4456-4a68-a411-afabda9c717c" containerID="9ac33378890d1c2c29cbde8bd3d1691e67622366be8088a2cd3a5fb5e0dfd16d" exitCode=0
Jul 02 19:13:21.835979 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.835903    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4" event={"ID":"64158035-4456-4a68-a411-afabda9c717c","Type":"ContainerDied","Data":"9ac33378890d1c2c29cbde8bd3d1691e67622366be8088a2cd3a5fb5e0dfd16d"}
Jul 02 19:13:21.837885 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.837867    2563 generic.go:356] "Generic (PLEG): container finished" podID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerID="db6dfc2f7492924eb80c292c131a4db6684e1c5fed8bf9915da2a95b475cec24" exitCode=0
Jul 02 19:13:21.837973 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:21.837899    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh" event={"ID":"aaf40b87-5bfe-4348-8908-29e579b0b0e3","Type":"ContainerDied","Data":"db6dfc2f7492924eb80c292c131a4db6684e1c5fed8bf9915da2a95b475cec24"}
Jul 02 19:13:22.844739 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:22.844705    2563 generic.go:356] "Generic (PLEG): container finished" podID="64158035-4456-4a68-a411-afabda9c717c" containerID="27f90b50b9d5e8b332e6abf94c6c5fcdc5c3ae158f36d7f31fb4ff3ebd6e5ffe" exitCode=0
Jul 02 19:13:22.845156 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:22.844795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4" event={"ID":"64158035-4456-4a68-a411-afabda9c717c","Type":"ContainerDied","Data":"27f90b50b9d5e8b332e6abf94c6c5fcdc5c3ae158f36d7f31fb4ff3ebd6e5ffe"}
Jul 02 19:13:22.846736 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:22.846714    2563 generic.go:356] "Generic (PLEG): container finished" podID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerID="f19c4cd34ef5b8583749fe6fa44caa32d1fe183be77d4493b1815992a6c3952f" exitCode=0
Jul 02 19:13:22.846874 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:22.846789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh" event={"ID":"aaf40b87-5bfe-4348-8908-29e579b0b0e3","Type":"ContainerDied","Data":"f19c4cd34ef5b8583749fe6fa44caa32d1fe183be77d4493b1815992a6c3952f"}
Jul 02 19:13:22.848569 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:22.848548    2563 generic.go:356] "Generic (PLEG): container finished" podID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerID="06fdc0eadcc2093ae6ec8f38bad01f23c8eb967a073d1fe7c337a25be32c7f77" exitCode=0
Jul 02 19:13:22.848658 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:22.848580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv" event={"ID":"3adc51d2-0726-4272-9526-bee8ce4eba92","Type":"ContainerDied","Data":"06fdc0eadcc2093ae6ec8f38bad01f23c8eb967a073d1fe7c337a25be32c7f77"}
Jul 02 19:13:23.856362 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:23.856318    2563 generic.go:356] "Generic (PLEG): container finished" podID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerID="911e05f5df022a4972330fbc7f5c1775dcd13e36308d4061e2c44d1d80b42f43" exitCode=0
Jul 02 19:13:23.856785 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:23.856399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv" event={"ID":"3adc51d2-0726-4272-9526-bee8ce4eba92","Type":"ContainerDied","Data":"911e05f5df022a4972330fbc7f5c1775dcd13e36308d4061e2c44d1d80b42f43"}
Jul 02 19:13:24.019050 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.019027    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:24.021616 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.021598    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:24.098320 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098295    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-bundle\") pod \"64158035-4456-4a68-a411-afabda9c717c\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") "
Jul 02 19:13:24.098447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098365    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-util\") pod \"64158035-4456-4a68-a411-afabda9c717c\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") "
Jul 02 19:13:24.098447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmbnt\" (UniqueName: \"kubernetes.io/projected/aaf40b87-5bfe-4348-8908-29e579b0b0e3-kube-api-access-kmbnt\") pod \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") "
Jul 02 19:13:24.098447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098410    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-util\") pod \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") "
Jul 02 19:13:24.098447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098427    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-bundle\") pod \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\" (UID: \"aaf40b87-5bfe-4348-8908-29e579b0b0e3\") "
Jul 02 19:13:24.098668 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkg2l\" (UniqueName: \"kubernetes.io/projected/64158035-4456-4a68-a411-afabda9c717c-kube-api-access-fkg2l\") pod \"64158035-4456-4a68-a411-afabda9c717c\" (UID: \"64158035-4456-4a68-a411-afabda9c717c\") "
Jul 02 19:13:24.099029 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.098996    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-bundle" (OuterVolumeSpecName: "bundle") pod "aaf40b87-5bfe-4348-8908-29e579b0b0e3" (UID: "aaf40b87-5bfe-4348-8908-29e579b0b0e3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:13:24.099191 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.099166    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-bundle" (OuterVolumeSpecName: "bundle") pod "64158035-4456-4a68-a411-afabda9c717c" (UID: "64158035-4456-4a68-a411-afabda9c717c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:13:24.100782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.100755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf40b87-5bfe-4348-8908-29e579b0b0e3-kube-api-access-kmbnt" (OuterVolumeSpecName: "kube-api-access-kmbnt") pod "aaf40b87-5bfe-4348-8908-29e579b0b0e3" (UID: "aaf40b87-5bfe-4348-8908-29e579b0b0e3"). InnerVolumeSpecName "kube-api-access-kmbnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:24.100988 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.100968    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64158035-4456-4a68-a411-afabda9c717c-kube-api-access-fkg2l" (OuterVolumeSpecName: "kube-api-access-fkg2l") pod "64158035-4456-4a68-a411-afabda9c717c" (UID: "64158035-4456-4a68-a411-afabda9c717c"). InnerVolumeSpecName "kube-api-access-fkg2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:24.104464 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.104431    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-util" (OuterVolumeSpecName: "util") pod "64158035-4456-4a68-a411-afabda9c717c" (UID: "64158035-4456-4a68-a411-afabda9c717c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:13:24.106287 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.106262    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-util" (OuterVolumeSpecName: "util") pod "aaf40b87-5bfe-4348-8908-29e579b0b0e3" (UID: "aaf40b87-5bfe-4348-8908-29e579b0b0e3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:13:24.199054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.199028    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-util\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:24.199054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.199051    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmbnt\" (UniqueName: \"kubernetes.io/projected/aaf40b87-5bfe-4348-8908-29e579b0b0e3-kube-api-access-kmbnt\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:24.199246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.199062    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-util\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:24.199246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.199070    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf40b87-5bfe-4348-8908-29e579b0b0e3-bundle\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:24.199246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.199077    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkg2l\" (UniqueName: \"kubernetes.io/projected/64158035-4456-4a68-a411-afabda9c717c-kube-api-access-fkg2l\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:24.199246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.199085    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64158035-4456-4a68-a411-afabda9c717c-bundle\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:24.863328 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.863289    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh"
Jul 02 19:13:24.863328 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.863307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh" event={"ID":"aaf40b87-5bfe-4348-8908-29e579b0b0e3","Type":"ContainerDied","Data":"04f751607960c48fb5f33a0ac89e4c0cedfa628c9117300cc3b1a3b93b49ea4c"}
Jul 02 19:13:24.863782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.863391    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04f751607960c48fb5f33a0ac89e4c0cedfa628c9117300cc3b1a3b93b49ea4c"
Jul 02 19:13:24.865127 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.865098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4" event={"ID":"64158035-4456-4a68-a411-afabda9c717c","Type":"ContainerDied","Data":"14bf7348f2e6f4a782fe95de4cbcc96b2aa48d8b85982f23a18d471f3e1330b0"}
Jul 02 19:13:24.865255 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.865146    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="14bf7348f2e6f4a782fe95de4cbcc96b2aa48d8b85982f23a18d471f3e1330b0"
Jul 02 19:13:24.865255 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.865159    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4"
Jul 02 19:13:24.989567 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:24.989543    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:25.107727 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.107696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6jlm\" (UniqueName: \"kubernetes.io/projected/3adc51d2-0726-4272-9526-bee8ce4eba92-kube-api-access-j6jlm\") pod \"3adc51d2-0726-4272-9526-bee8ce4eba92\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") "
Jul 02 19:13:25.107894 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.107741    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-util\") pod \"3adc51d2-0726-4272-9526-bee8ce4eba92\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") "
Jul 02 19:13:25.107894 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.107759    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-bundle\") pod \"3adc51d2-0726-4272-9526-bee8ce4eba92\" (UID: \"3adc51d2-0726-4272-9526-bee8ce4eba92\") "
Jul 02 19:13:25.108293 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.108267    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-bundle" (OuterVolumeSpecName: "bundle") pod "3adc51d2-0726-4272-9526-bee8ce4eba92" (UID: "3adc51d2-0726-4272-9526-bee8ce4eba92"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:13:25.109748 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.109721    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3adc51d2-0726-4272-9526-bee8ce4eba92-kube-api-access-j6jlm" (OuterVolumeSpecName: "kube-api-access-j6jlm") pod "3adc51d2-0726-4272-9526-bee8ce4eba92" (UID: "3adc51d2-0726-4272-9526-bee8ce4eba92"). InnerVolumeSpecName "kube-api-access-j6jlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:13:25.113092 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.113073    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-util" (OuterVolumeSpecName: "util") pod "3adc51d2-0726-4272-9526-bee8ce4eba92" (UID: "3adc51d2-0726-4272-9526-bee8ce4eba92"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:13:25.208908 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.208879    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-util\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:25.208908 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.208903    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3adc51d2-0726-4272-9526-bee8ce4eba92-bundle\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:25.208908 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.208913    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6jlm\" (UniqueName: \"kubernetes.io/projected/3adc51d2-0726-4272-9526-bee8ce4eba92-kube-api-access-j6jlm\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:13:25.871474 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.871441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv" event={"ID":"3adc51d2-0726-4272-9526-bee8ce4eba92","Type":"ContainerDied","Data":"74de23e3181f041361da3ae7abe2abf5d0ed02a409068df8d520bd086e1c0f4c"}
Jul 02 19:13:25.871474 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.871472    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv"
Jul 02 19:13:25.871896 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:13:25.871491    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74de23e3181f041361da3ae7abe2abf5d0ed02a409068df8d520bd086e1c0f4c"
Jul 02 19:14:32.189878 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.189845    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190264    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="util"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190276    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="util"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190282    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="util"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190288    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="util"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190299    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="util"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190306    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="util"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190313    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="pull"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190317    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="pull"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190323    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="pull"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190327    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="pull"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190335    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="extract"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190340    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="extract"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190345    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="extract"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190351    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="extract"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190359    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="extract"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190364    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="extract"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190372    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="pull"
Jul 02 19:14:32.190372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190377    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="pull"
Jul 02 19:14:32.190872 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190430    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf40b87-5bfe-4348-8908-29e579b0b0e3" containerName="extract"
Jul 02 19:14:32.190872 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3adc51d2-0726-4272-9526-bee8ce4eba92" containerName="extract"
Jul 02 19:14:32.190872 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.190446    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64158035-4456-4a68-a411-afabda9c717c" containerName="extract"
Jul 02 19:14:32.193478 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.193460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.199774 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.199742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 19:14:32.199991 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.199974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:14:32.201368 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.201344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:14:32.201582 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.201567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2chrd\""
Jul 02 19:14:32.207630 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.207610    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:14:32.224611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.224592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fe8c884-1a4c-4a81-b020-4c9a4274197f-config-file\") pod \"limitador-limitador-54d6d988d5-pshv8\" (UID: \"7fe8c884-1a4c-4a81-b020-4c9a4274197f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.224735 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.224669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsbcp\" (UniqueName: \"kubernetes.io/projected/7fe8c884-1a4c-4a81-b020-4c9a4274197f-kube-api-access-dsbcp\") pod \"limitador-limitador-54d6d988d5-pshv8\" (UID: \"7fe8c884-1a4c-4a81-b020-4c9a4274197f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.256633 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.256608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:14:32.325030 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.325005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsbcp\" (UniqueName: \"kubernetes.io/projected/7fe8c884-1a4c-4a81-b020-4c9a4274197f-kube-api-access-dsbcp\") pod \"limitador-limitador-54d6d988d5-pshv8\" (UID: \"7fe8c884-1a4c-4a81-b020-4c9a4274197f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.325160 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.325038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fe8c884-1a4c-4a81-b020-4c9a4274197f-config-file\") pod \"limitador-limitador-54d6d988d5-pshv8\" (UID: \"7fe8c884-1a4c-4a81-b020-4c9a4274197f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.325622 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.325604    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7fe8c884-1a4c-4a81-b020-4c9a4274197f-config-file\") pod \"limitador-limitador-54d6d988d5-pshv8\" (UID: \"7fe8c884-1a4c-4a81-b020-4c9a4274197f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.333069 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.333051    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsbcp\" (UniqueName: \"kubernetes.io/projected/7fe8c884-1a4c-4a81-b020-4c9a4274197f-kube-api-access-dsbcp\") pod \"limitador-limitador-54d6d988d5-pshv8\" (UID: \"7fe8c884-1a4c-4a81-b020-4c9a4274197f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.505146 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.505073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:32.636184 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:32.636164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:14:32.638076 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:14:32.638050    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe8c884_1a4c_4a81_b020_4c9a4274197f.slice/crio-f458b2fb83a048be1f64285e08e689582fdf8b7e1cf0afd808aca3cc595bacce WatchSource:0}: Error finding container f458b2fb83a048be1f64285e08e689582fdf8b7e1cf0afd808aca3cc595bacce: Status 404 returned error can't find the container with id f458b2fb83a048be1f64285e08e689582fdf8b7e1cf0afd808aca3cc595bacce
Jul 02 19:14:33.187832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:33.187789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8" event={"ID":"7fe8c884-1a4c-4a81-b020-4c9a4274197f","Type":"ContainerStarted","Data":"f458b2fb83a048be1f64285e08e689582fdf8b7e1cf0afd808aca3cc595bacce"}
Jul 02 19:14:36.203670 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:36.203635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8" event={"ID":"7fe8c884-1a4c-4a81-b020-4c9a4274197f","Type":"ContainerStarted","Data":"167c8921c04404bd7c7ace499d08d14945392f431b5955f04d4f0d2a9a158eaa"}
Jul 02 19:14:36.204049 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:36.203774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:14:36.223333 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:36.223289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8" podStartSLOduration=1.5128350350000002 podStartE2EDuration="4.223276473s" totalImagesPullingTime="2.710441438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:36.221466683 +0000 UTC m=+558.221603476" watchObservedRunningTime="2026-07-02 19:14:36.223276473 +0000 UTC m=+558.223413296"
Jul 02 19:14:47.209336 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:14:47.209308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pshv8"
Jul 02 19:15:18.362918 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:18.362892    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:15:18.363540 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:18.363523    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:15:18.368825 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:18.368805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:15:18.369617 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:18.369599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:15:46.896735 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:46.896700    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qvsw5"]
Jul 02 19:15:46.900037 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:46.900022    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:46.904512 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:46.904493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rqszr\""
Jul 02 19:15:46.905011 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:46.904998    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 19:15:46.913696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:46.913674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qvsw5"]
Jul 02 19:15:46.932508 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:46.932488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:15:47.039927 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.039895    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqbkj\" (UniqueName: \"kubernetes.io/projected/1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a-kube-api-access-dqbkj\") pod \"payload-pre-processing-7964457696-qvsw5\" (UID: \"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a\") " pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.040087 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.039969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qvsw5\" (UID: \"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a\") " pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.141212 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.141171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qvsw5\" (UID: \"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a\") " pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.141385 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.141290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqbkj\" (UniqueName: \"kubernetes.io/projected/1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a-kube-api-access-dqbkj\") pod \"payload-pre-processing-7964457696-qvsw5\" (UID: \"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a\") " pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.141902 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.141878    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qvsw5\" (UID: \"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a\") " pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.151077 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.151022    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqbkj\" (UniqueName: \"kubernetes.io/projected/1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a-kube-api-access-dqbkj\") pod \"payload-pre-processing-7964457696-qvsw5\" (UID: \"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a\") " pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.209866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.209846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:47.341186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.341161    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qvsw5"]
Jul 02 19:15:47.343182 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:15:47.343144    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e27b5e0_0237_4b2d_b84c_1fed9c4ebf3a.slice/crio-8e7855adaa38c0ceb079b4eaa436b05cd8dbec0690a36d3c98512fe2829bd67b WatchSource:0}: Error finding container 8e7855adaa38c0ceb079b4eaa436b05cd8dbec0690a36d3c98512fe2829bd67b: Status 404 returned error can't find the container with id 8e7855adaa38c0ceb079b4eaa436b05cd8dbec0690a36d3c98512fe2829bd67b
Jul 02 19:15:47.536906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:47.536877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5" event={"ID":"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a","Type":"ContainerStarted","Data":"8e7855adaa38c0ceb079b4eaa436b05cd8dbec0690a36d3c98512fe2829bd67b"}
Jul 02 19:15:49.547617 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:49.547583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5" event={"ID":"1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a","Type":"ContainerStarted","Data":"db05aeb2da0e841bd71e27cea555b9a5394c0251ba4d8beec062c8dff479233d"}
Jul 02 19:15:49.548000 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:49.547701    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:15:49.564233 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:15:49.564168    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5" podStartSLOduration=1.912734801 podStartE2EDuration="3.564155209s" totalImagesPullingTime="1.651420408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:15:49.562323164 +0000 UTC m=+631.562459957" watchObservedRunningTime="2026-07-02 19:15:49.564155209 +0000 UTC m=+631.564291982"
Jul 02 19:16:00.560598 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:16:00.560568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qvsw5"
Jul 02 19:16:08.083518 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:16:08.083488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:16:14.065384 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:16:14.065350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:16:18.762744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:16:18.762708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:16:35.479245 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:16:35.479208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:16:54.763398 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:16:54.763364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:17:01.467665 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:17:01.467631    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:18:20.375765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:18:20.375730    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:18:31.166059 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:18:31.166010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:18:42.858761 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:18:42.858678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:18:51.469497 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:18:51.469460    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:19:02.866654 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:19:02.866620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:20:07.666448 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:07.666413    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:20:16.266082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:16.266048    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:20:18.401352 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:18.401326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:20:18.401784 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:18.401380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:20:18.407741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:18.407721    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:20:18.408010 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:18.407994    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:20:26.069482 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:26.069439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:20:31.565044 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:31.565006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:20:40.868247 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:40.868210    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:20:51.969754 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:20:51.969719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:21:03.660387 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:21:03.660355    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:21:10.377758 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:21:10.377721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:21:17.761312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:21:17.761281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:21:27.554053 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:21:27.554018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:21:39.258739 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:21:39.258691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:21:51.225247 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:21:51.225139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:22:13.862159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:22:13.862125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:22:24.562544 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:22:24.562513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:22:40.260297 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:22:40.260265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:22:51.674795 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:22:51.674753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:23:01.169611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:23:01.169576    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:23:10.468744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:23:10.468664    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:23:19.657913 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:23:19.657877    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:25:08.559625 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:08.559543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:25:17.555756 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:17.555720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:25:18.433021 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:18.432998    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:25:18.434345 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:18.434328    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:25:18.439313 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:18.439294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:25:18.440879 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:18.440866    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:25:30.059259 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:30.059224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:25:41.677184 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:41.677147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:25:53.161879 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:25:53.161844    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:26:03.559153 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:26:03.559108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:26:12.460597 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:26:12.460515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:26:22.970513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:26:22.970480    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:26:34.555324 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:26:34.555290    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:26:43.259680 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:26:43.259647    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:26:54.166784 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:26:54.166748    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:27:18.663035 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:27:18.662998    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:27:24.861777 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:27:24.861733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:27:34.161335 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:27:34.161297    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:27:45.252083 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:27:45.251994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:28:02.271632 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:28:02.271600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:28:14.112354 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:28:14.112319    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:28:22.876810 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:28:22.876781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:28:32.969312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:28:32.969278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:28:42.276073 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:28:42.276041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:28:51.764705 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:28:51.764671    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:29:04.373365 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:29:04.373328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:29:14.068129 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:29:14.068056    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:29:23.268941 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:29:23.268903    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:29:35.666867 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:29:35.666835    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:29:45.872581 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:29:45.872544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:29:52.067662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:29:52.067625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:30:00.140709 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.140675    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-s2ljs"]
Jul 02 19:30:00.144221 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.144190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:00.146686 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.146669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:30:00.162145 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.162110    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-s2ljs"]
Jul 02 19:30:00.233366 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.233344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ld56\" (UniqueName: \"kubernetes.io/projected/78c5486e-e17d-464e-9b97-51320b652df5-kube-api-access-2ld56\") pod \"maas-api-key-cleanup-29717010-s2ljs\" (UID: \"78c5486e-e17d-464e-9b97-51320b652df5\") " pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:00.334427 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.334401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ld56\" (UniqueName: \"kubernetes.io/projected/78c5486e-e17d-464e-9b97-51320b652df5-kube-api-access-2ld56\") pod \"maas-api-key-cleanup-29717010-s2ljs\" (UID: \"78c5486e-e17d-464e-9b97-51320b652df5\") " pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:00.342900 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.342872    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ld56\" (UniqueName: \"kubernetes.io/projected/78c5486e-e17d-464e-9b97-51320b652df5-kube-api-access-2ld56\") pod \"maas-api-key-cleanup-29717010-s2ljs\" (UID: \"78c5486e-e17d-464e-9b97-51320b652df5\") " pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:00.453955 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.453876    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:00.792771 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.792746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717010-s2ljs"]
Jul 02 19:30:00.794678 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:30:00.794650    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c5486e_e17d_464e_9b97_51320b652df5.slice/crio-3868a4582847040918c2505383a81747f15d60447356da7cc2b673c50b6d7c9a WatchSource:0}: Error finding container 3868a4582847040918c2505383a81747f15d60447356da7cc2b673c50b6d7c9a: Status 404 returned error can't find the container with id 3868a4582847040918c2505383a81747f15d60447356da7cc2b673c50b6d7c9a
Jul 02 19:30:00.796679 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:00.796661    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:30:01.647112 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:01.647075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs" event={"ID":"78c5486e-e17d-464e-9b97-51320b652df5","Type":"ContainerStarted","Data":"3868a4582847040918c2505383a81747f15d60447356da7cc2b673c50b6d7c9a"}
Jul 02 19:30:04.663395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:04.663365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs" event={"ID":"78c5486e-e17d-464e-9b97-51320b652df5","Type":"ContainerStarted","Data":"655f2e108a7e584115f3420a71e474e46dc708986a2d4a1c27425d43e3751ffa"}
Jul 02 19:30:04.682412 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:04.682364    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs" podStartSLOduration=1.2403598439999999 podStartE2EDuration="4.682349417s" totalImagesPullingTime="3.441989573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:30:04.679627046 +0000 UTC m=+1486.679763840" watchObservedRunningTime="2026-07-02 19:30:04.682349417 +0000 UTC m=+1486.682486210"
Jul 02 19:30:05.669828 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:05.669796    2563 generic.go:356] "Generic (PLEG): container finished" podID="78c5486e-e17d-464e-9b97-51320b652df5" containerID="655f2e108a7e584115f3420a71e474e46dc708986a2d4a1c27425d43e3751ffa" exitCode=0
Jul 02 19:30:05.670296 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:05.669834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs" event={"ID":"78c5486e-e17d-464e-9b97-51320b652df5","Type":"ContainerDied","Data":"655f2e108a7e584115f3420a71e474e46dc708986a2d4a1c27425d43e3751ffa"}
Jul 02 19:30:06.760023 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:06.759994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:30:06.803519 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:06.803497    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:06.889950 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:06.889921    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ld56\" (UniqueName: \"kubernetes.io/projected/78c5486e-e17d-464e-9b97-51320b652df5-kube-api-access-2ld56\") pod \"78c5486e-e17d-464e-9b97-51320b652df5\" (UID: \"78c5486e-e17d-464e-9b97-51320b652df5\") "
Jul 02 19:30:06.892051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:06.892024    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78c5486e-e17d-464e-9b97-51320b652df5-kube-api-access-2ld56" (OuterVolumeSpecName: "kube-api-access-2ld56") pod "78c5486e-e17d-464e-9b97-51320b652df5" (UID: "78c5486e-e17d-464e-9b97-51320b652df5"). InnerVolumeSpecName "kube-api-access-2ld56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:30:06.991423 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:06.991348    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ld56\" (UniqueName: \"kubernetes.io/projected/78c5486e-e17d-464e-9b97-51320b652df5-kube-api-access-2ld56\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:30:07.681286 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:07.681260    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs"
Jul 02 19:30:07.681447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:07.681302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717010-s2ljs" event={"ID":"78c5486e-e17d-464e-9b97-51320b652df5","Type":"ContainerDied","Data":"3868a4582847040918c2505383a81747f15d60447356da7cc2b673c50b6d7c9a"}
Jul 02 19:30:07.681447 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:07.681346    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3868a4582847040918c2505383a81747f15d60447356da7cc2b673c50b6d7c9a"
Jul 02 19:30:18.271521 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:18.271486    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:30:18.465542 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:18.465511    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:30:18.467838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:18.467814    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:30:18.472260 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:18.472238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:30:18.473858 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:18.473842    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:30:31.379235 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:31.379187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:30:40.262291 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:40.262191    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:30:52.767326 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:30:52.765614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:31:00.686362 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:00.686331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:31:07.036891 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.036857    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"]
Jul 02 19:31:07.037407 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.037383    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78c5486e-e17d-464e-9b97-51320b652df5" containerName="cleanup"
Jul 02 19:31:07.037561 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.037543    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="78c5486e-e17d-464e-9b97-51320b652df5" containerName="cleanup"
Jul 02 19:31:07.037664 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.037654    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="78c5486e-e17d-464e-9b97-51320b652df5" containerName="cleanup"
Jul 02 19:31:07.041140 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.041097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.045815 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.045786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4f4ba489-openshift-default-dockercfg-l8b8b\""
Jul 02 19:31:07.059018 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.058991    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"]
Jul 02 19:31:07.112079 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-credential-socket\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-data\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-istio-token\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112234    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpvgp\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-kube-api-access-bpvgp\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-socket\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a137d54-b50f-412b-aff8-ddc465f37935-istio-podinfo\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a137d54-b50f-412b-aff8-ddc465f37935-istiod-ca-cert\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112367    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-envoy\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.112434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.112426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-certs\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-socket\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213409 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a137d54-b50f-412b-aff8-ddc465f37935-istio-podinfo\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213409 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a137d54-b50f-412b-aff8-ddc465f37935-istiod-ca-cert\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213409 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-envoy\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213578 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-certs\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213578 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-credential-socket\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213578 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-data\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213734 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-istio-token\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213734 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-socket\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213734 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpvgp\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-kube-api-access-bpvgp\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213867 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213819    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-data\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213923 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213869    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-credential-socket\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.213980 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.213964    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a137d54-b50f-412b-aff8-ddc465f37935-istiod-ca-cert\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.214032 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.214008    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-certs\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.215516 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.215497    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-envoy\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.215737 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.215720    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a137d54-b50f-412b-aff8-ddc465f37935-istio-podinfo\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.221763 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.221741    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-istio-token\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.222183 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.222165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpvgp\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-kube-api-access-bpvgp\") pod \"e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") " pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.353401 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.353311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:07.495970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.495944    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"]
Jul 02 19:31:07.497664 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:31:07.497636    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a137d54_b50f_412b_aff8_ddc465f37935.slice/crio-cda76cb2cc2032cdf784427695430d4ff4e3e122f65e30c632416af3d3b1f8a6 WatchSource:0}: Error finding container cda76cb2cc2032cdf784427695430d4ff4e3e122f65e30c632416af3d3b1f8a6: Status 404 returned error can't find the container with id cda76cb2cc2032cdf784427695430d4ff4e3e122f65e30c632416af3d3b1f8a6
Jul 02 19:31:07.970866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:07.970830    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" event={"ID":"9a137d54-b50f-412b-aff8-ddc465f37935","Type":"ContainerStarted","Data":"cda76cb2cc2032cdf784427695430d4ff4e3e122f65e30c632416af3d3b1f8a6"}
Jul 02 19:31:10.112385 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:10.112348    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:31:10.112661 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:10.112424    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:31:10.112661 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:10.112453    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:31:10.992513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:10.992480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" event={"ID":"9a137d54-b50f-412b-aff8-ddc465f37935","Type":"ContainerStarted","Data":"67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e"}
Jul 02 19:31:11.014969 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:11.014927    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" podStartSLOduration=1.402502593 podStartE2EDuration="4.014911413s" totalImagesPullingTime="2.61240882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:31:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:31:11.013393764 +0000 UTC m=+1553.013530556" watchObservedRunningTime="2026-07-02 19:31:11.014911413 +0000 UTC m=+1553.015048205"
Jul 02 19:31:11.354249 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:11.354221    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:11.358739 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:11.358716    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:11.997018 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:11.996986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:11.998043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:11.998022    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:13.575103 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:13.575071    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"]
Jul 02 19:31:14.006606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:14.006514    2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" secret="" err="secret \"e2e-ait-4f4ba489-openshift-default-dockercfg-l8b8b\" not found"
Jul 02 19:31:15.011085 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:15.011031    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" podUID="9a137d54-b50f-412b-aff8-ddc465f37935" containerName="istio-proxy" containerID="cri-o://67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e" gracePeriod=30
Jul 02 19:31:20.262078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.262054    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:20.324483 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324400    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-socket\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324483 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-certs\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324485    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpvgp\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-kube-api-access-bpvgp\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324508    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-istio-token\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324538    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a137d54-b50f-412b-aff8-ddc465f37935-istiod-ca-cert\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324568    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a137d54-b50f-412b-aff8-ddc465f37935-istio-podinfo\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324600    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-credential-socket\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324629    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-envoy\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324674    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:20.324696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-data\") pod \"9a137d54-b50f-412b-aff8-ddc465f37935\" (UID: \"9a137d54-b50f-412b-aff8-ddc465f37935\") "
Jul 02 19:31:20.325071 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324811    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:20.325071 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324995    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.325071 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.325013    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.325071 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.324995    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:20.325071 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.325035    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:20.325272 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.325073    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a137d54-b50f-412b-aff8-ddc465f37935-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:31:20.326930 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.326893    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:31:20.326930 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.326920    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-kube-api-access-bpvgp" (OuterVolumeSpecName: "kube-api-access-bpvgp") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "kube-api-access-bpvgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:31:20.327075 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.326932    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a137d54-b50f-412b-aff8-ddc465f37935-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:31:20.327075 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.326965    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a137d54-b50f-412b-aff8-ddc465f37935" (UID: "9a137d54-b50f-412b-aff8-ddc465f37935"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:20.425998 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.425967    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpvgp\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-kube-api-access-bpvgp\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.425998 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.425993    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a137d54-b50f-412b-aff8-ddc465f37935-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.425998 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.426002    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a137d54-b50f-412b-aff8-ddc465f37935-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.426234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.426009    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a137d54-b50f-412b-aff8-ddc465f37935-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.426234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.426018    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.426234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.426026    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:20.426234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:20.426034    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a137d54-b50f-412b-aff8-ddc465f37935-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:21.042561 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.042522    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a137d54-b50f-412b-aff8-ddc465f37935" containerID="67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e" exitCode=0
Jul 02 19:31:21.042561 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.042563    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"
Jul 02 19:31:21.042758 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.042574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" event={"ID":"9a137d54-b50f-412b-aff8-ddc465f37935","Type":"ContainerDied","Data":"67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e"}
Jul 02 19:31:21.042758 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.042622    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m" event={"ID":"9a137d54-b50f-412b-aff8-ddc465f37935","Type":"ContainerDied","Data":"cda76cb2cc2032cdf784427695430d4ff4e3e122f65e30c632416af3d3b1f8a6"}
Jul 02 19:31:21.042758 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.042646    2563 scope.go:117] "RemoveContainer" containerID="67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e"
Jul 02 19:31:21.051589 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.051570    2563 scope.go:117] "RemoveContainer" containerID="67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e"
Jul 02 19:31:21.051827 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:31:21.051809    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e\": container with ID starting with 67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e not found: ID does not exist" containerID="67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e"
Jul 02 19:31:21.051877 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.051836    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e"} err="failed to get container status \"67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e\": rpc error: code = NotFound desc = could not find container \"67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e\": container with ID starting with 67b2a8a93521e3fa0c9d02f2b9470457f1af7352aab7eaace9ed68a744f8961e not found: ID does not exist"
Jul 02 19:31:21.059730 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.059704    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"]
Jul 02 19:31:21.064179 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.064159    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4f4ba489-openshift-default-6d45fbd7f-f2q2m"]
Jul 02 19:31:21.509242 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.509160    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"]
Jul 02 19:31:21.509565 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.509538    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a137d54-b50f-412b-aff8-ddc465f37935" containerName="istio-proxy"
Jul 02 19:31:21.509565 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.509550    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a137d54-b50f-412b-aff8-ddc465f37935" containerName="istio-proxy"
Jul 02 19:31:21.509632 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.509612    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a137d54-b50f-412b-aff8-ddc465f37935" containerName="istio-proxy"
Jul 02 19:31:21.514078 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.514062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.519712 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.519689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:31:21.520614 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.520301    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-038ccab4-serving-cert\""
Jul 02 19:31:21.534540 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.534516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.534673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.534572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-openshift-service-ca\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.534673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.534608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c2jl\" (UniqueName: \"kubernetes.io/projected/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-kube-api-access-5c2jl\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.536554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.536535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"]
Jul 02 19:31:21.635184 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.635150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.635384 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.635221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-openshift-service-ca\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.635384 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.635258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c2jl\" (UniqueName: \"kubernetes.io/projected/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-kube-api-access-5c2jl\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.635384 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:31:21.635309    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-038ccab4-serving-cert: secret "maas-api-e2e-ait-038ccab4-serving-cert" not found
Jul 02 19:31:21.635552 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:31:21.635414    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls podName:8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b nodeName:}" failed. No retries permitted until 2026-07-02 19:31:22.135392004 +0000 UTC m=+1564.135528776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls") pod "maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" (UID: "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b") : secret "maas-api-e2e-ait-038ccab4-serving-cert" not found
Jul 02 19:31:21.635868 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.635847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-openshift-service-ca\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:21.652458 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:21.652434    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c2jl\" (UniqueName: \"kubernetes.io/projected/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-kube-api-access-5c2jl\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:22.141329 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:22.141296    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:22.143765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:22.143739    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls\") pod \"maas-api-e2e-ait-038ccab4-646c64877c-rhpgv\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") " pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:22.423606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:22.423522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:22.495827 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:22.495796    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a137d54-b50f-412b-aff8-ddc465f37935" path="/var/lib/kubelet/pods/9a137d54-b50f-412b-aff8-ddc465f37935/volumes"
Jul 02 19:31:22.556871 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:22.556847    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"]
Jul 02 19:31:22.559041 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:31:22.559016    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb3ff09_6bee_4faa_bb2e_f1ac48d7e71b.slice/crio-bdff86462023be04a828c2ed2fb928e0e77f269470f6859cca9340d28c4a647f WatchSource:0}: Error finding container bdff86462023be04a828c2ed2fb928e0e77f269470f6859cca9340d28c4a647f: Status 404 returned error can't find the container with id bdff86462023be04a828c2ed2fb928e0e77f269470f6859cca9340d28c4a647f
Jul 02 19:31:23.055958 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:23.055921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" event={"ID":"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b","Type":"ContainerStarted","Data":"bdff86462023be04a828c2ed2fb928e0e77f269470f6859cca9340d28c4a647f"}
Jul 02 19:31:25.067316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:25.067274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" event={"ID":"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b","Type":"ContainerStarted","Data":"71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e"}
Jul 02 19:31:25.067697 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:25.067374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:25.088058 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:25.088009    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" podStartSLOduration=1.918755894 podStartE2EDuration="4.087995589s" totalImagesPullingTime="2.169239695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:31:25.086678699 +0000 UTC m=+1567.086815503" watchObservedRunningTime="2026-07-02 19:31:25.087995589 +0000 UTC m=+1567.088132382"
Jul 02 19:31:26.893298 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:26.893255    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"]
Jul 02 19:31:27.076530 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.076490    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" podUID="8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" containerName="maas-api" containerID="cri-o://71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e" gracePeriod=30
Jul 02 19:31:27.324054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.324024    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:27.386926 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.386898    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c2jl\" (UniqueName: \"kubernetes.io/projected/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-kube-api-access-5c2jl\") pod \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") "
Jul 02 19:31:27.387082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.386968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-openshift-service-ca\") pod \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") "
Jul 02 19:31:27.387082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.386996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls\") pod \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\" (UID: \"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b\") "
Jul 02 19:31:27.387388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.387361    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" (UID: "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:31:27.389016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.388986    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" (UID: "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:31:27.389016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.388990    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-kube-api-access-5c2jl" (OuterVolumeSpecName: "kube-api-access-5c2jl") pod "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" (UID: "8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b"). InnerVolumeSpecName "kube-api-access-5c2jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:31:27.488675 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.488596    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c2jl\" (UniqueName: \"kubernetes.io/projected/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-kube-api-access-5c2jl\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:27.488675 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.488623    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-openshift-service-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:27.488675 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:27.488634    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b-maas-api-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:28.082368 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.082334    2563 generic.go:356] "Generic (PLEG): container finished" podID="8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" containerID="71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e" exitCode=0
Jul 02 19:31:28.082825 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.082382    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"
Jul 02 19:31:28.082825 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.082416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" event={"ID":"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b","Type":"ContainerDied","Data":"71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e"}
Jul 02 19:31:28.082825 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.082466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv" event={"ID":"8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b","Type":"ContainerDied","Data":"bdff86462023be04a828c2ed2fb928e0e77f269470f6859cca9340d28c4a647f"}
Jul 02 19:31:28.082825 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.082487    2563 scope.go:117] "RemoveContainer" containerID="71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e"
Jul 02 19:31:28.092168 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.092149    2563 scope.go:117] "RemoveContainer" containerID="71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e"
Jul 02 19:31:28.092428 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:31:28.092409    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e\": container with ID starting with 71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e not found: ID does not exist" containerID="71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e"
Jul 02 19:31:28.092475 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.092436    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e"} err="failed to get container status \"71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e\": rpc error: code = NotFound desc = could not find container \"71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e\": container with ID starting with 71ada79b09c906a6351ff136931efd865155c549bc3e806004fe4b1b06c5ad1e not found: ID does not exist"
Jul 02 19:31:28.106033 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.106012    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"]
Jul 02 19:31:28.111924 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.111903    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-038ccab4-646c64877c-rhpgv"]
Jul 02 19:31:28.494535 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:28.494457    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" path="/var/lib/kubelet/pods/8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b/volumes"
Jul 02 19:31:39.319779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.319751    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"]
Jul 02 19:31:39.320115 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.320103    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" containerName="maas-api"
Jul 02 19:31:39.320151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.320117    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" containerName="maas-api"
Jul 02 19:31:39.320217 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.320185    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fb3ff09-6bee-4faa-bb2e-f1ac48d7e71b" containerName="maas-api"
Jul 02 19:31:39.326680 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.326660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.328943 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.328924    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-03f759d2-openshift-default-dockercfg-9zpv2\""
Jul 02 19:31:39.336302 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.336279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"]
Jul 02 19:31:39.384749 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istiod-ca-cert\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.384892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-certs\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.384892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-socket\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.384892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-data\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.384892 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-podinfo\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.385106 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384930    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-envoy\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.385106 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.384961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-token\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.385106 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.385014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-credential-socket\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.385106 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.385045    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxqww\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-kube-api-access-bxqww\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486469 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istiod-ca-cert\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486614 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486495    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-certs\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486614 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-socket\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486614 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-data\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486614 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-podinfo\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486614 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-envoy\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486871 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-token\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486871 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-credential-socket\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.486871 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxqww\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-kube-api-access-bxqww\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.487022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486902    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-socket\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.487022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.486934    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-certs\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.487117 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.487068    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istiod-ca-cert\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.487117 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.487096    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-credential-socket\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.487266 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.487249    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-data\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.488787 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.488765    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-envoy\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.489127 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.489105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-podinfo\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.495396 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.495378    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-token\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.496343 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.496323    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxqww\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-kube-api-access-bxqww\") pod \"e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") " pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.637058 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.636992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:39.771894 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.771869    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"]
Jul 02 19:31:39.774276 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:31:39.774248    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb56ea2b_0ede_4f87_9a99_0d667fd9beb7.slice/crio-ff91e3fcb1f1077feb780feb60e8258b8090812bc3c97447d88614f3e8eaccbd WatchSource:0}: Error finding container ff91e3fcb1f1077feb780feb60e8258b8090812bc3c97447d88614f3e8eaccbd: Status 404 returned error can't find the container with id ff91e3fcb1f1077feb780feb60e8258b8090812bc3c97447d88614f3e8eaccbd
Jul 02 19:31:39.776535 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.776505    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:31:39.776604 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.776568    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:31:39.776604 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:39.776596    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:31:40.144107 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:40.144074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5" event={"ID":"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7","Type":"ContainerStarted","Data":"21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651"}
Jul 02 19:31:40.144309 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:40.144126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5" event={"ID":"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7","Type":"ContainerStarted","Data":"ff91e3fcb1f1077feb780feb60e8258b8090812bc3c97447d88614f3e8eaccbd"}
Jul 02 19:31:40.168504 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:40.168431    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5" podStartSLOduration=1.168416068 podStartE2EDuration="1.168416068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:31:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:31:40.166998994 +0000 UTC m=+1582.167135790" watchObservedRunningTime="2026-07-02 19:31:40.168416068 +0000 UTC m=+1582.168552861"
Jul 02 19:31:40.637351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:40.637320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:40.641909 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:40.641888    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:41.149368 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:41.149337    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:41.150123 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:41.150108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:45.181902 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:45.181870    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"]
Jul 02 19:31:45.182394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:45.182034    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5" podUID="fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" containerName="istio-proxy" containerID="cri-o://21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651" gracePeriod=30
Jul 02 19:31:50.437233 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.437185    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:50.584743 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-podinfo\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.584915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584766    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istiod-ca-cert\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.584915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584786    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-certs\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.584915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584822    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-socket\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.584915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584838    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-token\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.584915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584878    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-data\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.585151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584925    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-envoy\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.585151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-credential-socket\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.585151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.584982    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxqww\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-kube-api-access-bxqww\") pod \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\" (UID: \"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7\") "
Jul 02 19:31:50.585334 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.585236    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:31:50.585334 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.585249    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:50.585334 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.585236    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:50.585473 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.585405    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:50.585532 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.585512    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:50.587257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.587155    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:31:50.587257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.587172    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-kube-api-access-bxqww" (OuterVolumeSpecName: "kube-api-access-bxqww") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "kube-api-access-bxqww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:31:50.587439 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.587284    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:31:50.587439 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.587296    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" (UID: "fb56ea2b-0ede-4f87-9a99-0d667fd9beb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:31:50.685852 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685819    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.685852 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685848    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.685852 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685858    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.686060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685866    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.686060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685874    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.686060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685882    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.686060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685890    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.686060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685898    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:50.686060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:50.685906    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxqww\" (UniqueName: \"kubernetes.io/projected/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7-kube-api-access-bxqww\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:31:51.202968 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.202939    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" containerID="21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651" exitCode=0
Jul 02 19:31:51.203122 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.202984    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"
Jul 02 19:31:51.203122 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.203033    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5" event={"ID":"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7","Type":"ContainerDied","Data":"21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651"}
Jul 02 19:31:51.203122 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.203086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5" event={"ID":"fb56ea2b-0ede-4f87-9a99-0d667fd9beb7","Type":"ContainerDied","Data":"ff91e3fcb1f1077feb780feb60e8258b8090812bc3c97447d88614f3e8eaccbd"}
Jul 02 19:31:51.203122 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.203115    2563 scope.go:117] "RemoveContainer" containerID="21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651"
Jul 02 19:31:51.212478 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.212460    2563 scope.go:117] "RemoveContainer" containerID="21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651"
Jul 02 19:31:51.212715 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:31:51.212697    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651\": container with ID starting with 21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651 not found: ID does not exist" containerID="21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651"
Jul 02 19:31:51.212772 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.212726    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651"} err="failed to get container status \"21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651\": rpc error: code = NotFound desc = could not find container \"21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651\": container with ID starting with 21fdcc56c27434d4175457f58c80745296c7ad18fc031bcfbd552f83e5086651 not found: ID does not exist"
Jul 02 19:31:51.226296 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.226271    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"]
Jul 02 19:31:51.230479 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:51.230461    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-03f759d2-openshift-default-5757966c9-tk8s5"]
Jul 02 19:31:52.495793 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:31:52.495759    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" path="/var/lib/kubelet/pods/fb56ea2b-0ede-4f87-9a99-0d667fd9beb7/volumes"
Jul 02 19:33:14.368719 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:14.368683    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:33:21.878354 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:21.878320    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:33:27.699535 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.699501    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"]
Jul 02 19:33:27.700030 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.700011    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" containerName="istio-proxy"
Jul 02 19:33:27.700107 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.700033    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" containerName="istio-proxy"
Jul 02 19:33:27.700158 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.700144    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb56ea2b-0ede-4f87-9a99-0d667fd9beb7" containerName="istio-proxy"
Jul 02 19:33:27.703394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.703375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.705951 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.705931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f622a885-openshift-default-dockercfg-d5pgt\""
Jul 02 19:33:27.731860 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.731828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"]
Jul 02 19:33:27.792458 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3076547a-937c-4020-99e1-f56c22b17c69-istiod-ca-cert\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-certs\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-envoy\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-data\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-istio-token\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkfzj\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-kube-api-access-kkfzj\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792927 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-credential-socket\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792927 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-socket\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.792927 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.792743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3076547a-937c-4020-99e1-f56c22b17c69-istio-podinfo\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893467 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3076547a-937c-4020-99e1-f56c22b17c69-istiod-ca-cert\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893467 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-certs\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893658 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-envoy\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893658 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-data\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893726 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-istio-token\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893726 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkfzj\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-kube-api-access-kkfzj\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893796 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-credential-socket\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893796 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-socket\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3076547a-937c-4020-99e1-f56c22b17c69-istio-podinfo\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.893952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893892    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-certs\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.894049 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.893952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-data\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.894160 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.894138    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-credential-socket\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.894225 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.894184    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-socket\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.894414 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.894398    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3076547a-937c-4020-99e1-f56c22b17c69-istiod-ca-cert\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.895623 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.895606    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-envoy\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.895966 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.895952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3076547a-937c-4020-99e1-f56c22b17c69-istio-podinfo\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.903453 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.903430    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkfzj\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-kube-api-access-kkfzj\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:27.903552 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:27.903519    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-istio-token\") pod \"e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") " pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:28.013254 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.013146    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:28.149875 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.149849    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"]
Jul 02 19:33:28.151597 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:33:28.151568    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3076547a_937c_4020_99e1_f56c22b17c69.slice/crio-da600fc880863a34c231b9a93f33d6e24c72315858b229eb4221a99c5f991b39 WatchSource:0}: Error finding container da600fc880863a34c231b9a93f33d6e24c72315858b229eb4221a99c5f991b39: Status 404 returned error can't find the container with id da600fc880863a34c231b9a93f33d6e24c72315858b229eb4221a99c5f991b39
Jul 02 19:33:28.153710 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.153680    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:33:28.153783 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.153744    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:33:28.153783 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.153773    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:33:28.676839 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.676803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" event={"ID":"3076547a-937c-4020-99e1-f56c22b17c69","Type":"ContainerStarted","Data":"2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"}
Jul 02 19:33:28.677006 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.676854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" event={"ID":"3076547a-937c-4020-99e1-f56c22b17c69","Type":"ContainerStarted","Data":"da600fc880863a34c231b9a93f33d6e24c72315858b229eb4221a99c5f991b39"}
Jul 02 19:33:28.700993 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:28.700947    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" podStartSLOduration=1.7009277539999998 podStartE2EDuration="1.700927754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:28.699245453 +0000 UTC m=+1690.699382255" watchObservedRunningTime="2026-07-02 19:33:28.700927754 +0000 UTC m=+1690.701064546"
Jul 02 19:33:29.014293 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:29.014266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:29.018823 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:29.018795    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:29.683234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:29.683180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:29.684033 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:29.684019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:30.265470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:30.265436    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:33:30.881785 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:30.881748    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"]
Jul 02 19:33:30.886007 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:30.885988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:30.888716 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:30.888689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-f622a885-serving-cert\""
Jul 02 19:33:30.888851 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:30.888758    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:33:30.897299 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:30.897279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"]
Jul 02 19:33:31.019792 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.019757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4500796d-59b5-4430-afbf-c2630fc3e65d-openshift-service-ca\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.019950 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.019800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.019950 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.019820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bz7q\" (UniqueName: \"kubernetes.io/projected/4500796d-59b5-4430-afbf-c2630fc3e65d-kube-api-access-5bz7q\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.120604 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.120566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4500796d-59b5-4430-afbf-c2630fc3e65d-openshift-service-ca\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.120779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.120616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.120779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.120645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bz7q\" (UniqueName: \"kubernetes.io/projected/4500796d-59b5-4430-afbf-c2630fc3e65d-kube-api-access-5bz7q\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.120905 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:33:31.120775    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-f622a885-serving-cert: secret "maas-api-e2e-mt-f622a885-serving-cert" not found
Jul 02 19:33:31.120905 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:33:31.120846    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls podName:4500796d-59b5-4430-afbf-c2630fc3e65d nodeName:}" failed. No retries permitted until 2026-07-02 19:33:31.620826997 +0000 UTC m=+1693.620963768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls") pod "maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" (UID: "4500796d-59b5-4430-afbf-c2630fc3e65d") : secret "maas-api-e2e-mt-f622a885-serving-cert" not found
Jul 02 19:33:31.121154 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.121135    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4500796d-59b5-4430-afbf-c2630fc3e65d-openshift-service-ca\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.135880 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.135823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bz7q\" (UniqueName: \"kubernetes.io/projected/4500796d-59b5-4430-afbf-c2630fc3e65d-kube-api-access-5bz7q\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.626021 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.625982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.628278 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.628250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls\") pod \"maas-api-e2e-mt-f622a885-54fccdb8b-46qvj\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") " pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.797356 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.797312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:31.927230 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:31.927205    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"]
Jul 02 19:33:31.929599 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:33:31.929572    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4500796d_59b5_4430_afbf_c2630fc3e65d.slice/crio-34249a4bfd8af6de4615fca880a5d31a93fa0978ad1d92dc066acd3485774f63 WatchSource:0}: Error finding container 34249a4bfd8af6de4615fca880a5d31a93fa0978ad1d92dc066acd3485774f63: Status 404 returned error can't find the container with id 34249a4bfd8af6de4615fca880a5d31a93fa0978ad1d92dc066acd3485774f63
Jul 02 19:33:32.699314 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:32.699229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" event={"ID":"4500796d-59b5-4430-afbf-c2630fc3e65d","Type":"ContainerStarted","Data":"47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8"}
Jul 02 19:33:32.699314 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:32.699291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" event={"ID":"4500796d-59b5-4430-afbf-c2630fc3e65d","Type":"ContainerStarted","Data":"34249a4bfd8af6de4615fca880a5d31a93fa0978ad1d92dc066acd3485774f63"}
Jul 02 19:33:32.699677 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:32.699318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:32.720463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:32.720419    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" podStartSLOduration=2.306574672 podStartE2EDuration="2.720403668s" totalImagesPullingTime="413.828996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:33:32.717427017 +0000 UTC m=+1694.717563810" watchObservedRunningTime="2026-07-02 19:33:32.720403668 +0000 UTC m=+1694.720540461"
Jul 02 19:33:38.709947 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:38.709913    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:40.167223 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:40.167165    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:33:42.888743 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:42.888710    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"]
Jul 02 19:33:42.889223 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:42.888926    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" podUID="4500796d-59b5-4430-afbf-c2630fc3e65d" containerName="maas-api" containerID="cri-o://47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8" gracePeriod=30
Jul 02 19:33:43.148652 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.148563    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:43.335776 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.335743    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4500796d-59b5-4430-afbf-c2630fc3e65d-openshift-service-ca\") pod \"4500796d-59b5-4430-afbf-c2630fc3e65d\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") "
Jul 02 19:33:43.335928 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.335879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls\") pod \"4500796d-59b5-4430-afbf-c2630fc3e65d\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") "
Jul 02 19:33:43.335928 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.335912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bz7q\" (UniqueName: \"kubernetes.io/projected/4500796d-59b5-4430-afbf-c2630fc3e65d-kube-api-access-5bz7q\") pod \"4500796d-59b5-4430-afbf-c2630fc3e65d\" (UID: \"4500796d-59b5-4430-afbf-c2630fc3e65d\") "
Jul 02 19:33:43.336138 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.336113    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4500796d-59b5-4430-afbf-c2630fc3e65d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4500796d-59b5-4430-afbf-c2630fc3e65d" (UID: "4500796d-59b5-4430-afbf-c2630fc3e65d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:33:43.337785 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.337759    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4500796d-59b5-4430-afbf-c2630fc3e65d" (UID: "4500796d-59b5-4430-afbf-c2630fc3e65d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:33:43.337849 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.337806    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4500796d-59b5-4430-afbf-c2630fc3e65d-kube-api-access-5bz7q" (OuterVolumeSpecName: "kube-api-access-5bz7q") pod "4500796d-59b5-4430-afbf-c2630fc3e65d" (UID: "4500796d-59b5-4430-afbf-c2630fc3e65d"). InnerVolumeSpecName "kube-api-access-5bz7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:33:43.436779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.436720    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4500796d-59b5-4430-afbf-c2630fc3e65d-maas-api-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:43.436779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.436744    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bz7q\" (UniqueName: \"kubernetes.io/projected/4500796d-59b5-4430-afbf-c2630fc3e65d-kube-api-access-5bz7q\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:43.436779 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.436757    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4500796d-59b5-4430-afbf-c2630fc3e65d-openshift-service-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:43.781015 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.780985    2563 generic.go:356] "Generic (PLEG): container finished" podID="3076547a-937c-4020-99e1-f56c22b17c69" containerID="2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114" exitCode=0
Jul 02 19:33:43.781181 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.781048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" event={"ID":"3076547a-937c-4020-99e1-f56c22b17c69","Type":"ContainerDied","Data":"2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"}
Jul 02 19:33:43.781486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.781468    2563 scope.go:117] "RemoveContainer" containerID="2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"
Jul 02 19:33:43.782352 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782336    2563 generic.go:356] "Generic (PLEG): container finished" podID="4500796d-59b5-4430-afbf-c2630fc3e65d" containerID="47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8" exitCode=0
Jul 02 19:33:43.782428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782413    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"
Jul 02 19:33:43.782472 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" event={"ID":"4500796d-59b5-4430-afbf-c2630fc3e65d","Type":"ContainerDied","Data":"47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8"}
Jul 02 19:33:43.782511 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782469    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj" event={"ID":"4500796d-59b5-4430-afbf-c2630fc3e65d","Type":"ContainerDied","Data":"34249a4bfd8af6de4615fca880a5d31a93fa0978ad1d92dc066acd3485774f63"}
Jul 02 19:33:43.782511 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782498    2563 scope.go:117] "RemoveContainer" containerID="47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8"
Jul 02 19:33:43.782585 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782505    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:33:43.782585 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782574    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:33:43.782660 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.782620    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:33:43.793956 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.793940    2563 scope.go:117] "RemoveContainer" containerID="47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8"
Jul 02 19:33:43.794176 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:33:43.794159    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8\": container with ID starting with 47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8 not found: ID does not exist" containerID="47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8"
Jul 02 19:33:43.794246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.794183    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8"} err="failed to get container status \"47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8\": rpc error: code = NotFound desc = could not find container \"47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8\": container with ID starting with 47e13a532ec4e9db03c09ae4a3c7ca4f4b7785b32ef88a1a7def2efd057608c8 not found: ID does not exist"
Jul 02 19:33:43.817935 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.817892    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"]
Jul 02 19:33:43.822375 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:43.822349    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-f622a885-54fccdb8b-46qvj"]
Jul 02 19:33:44.495713 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:44.495678    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4500796d-59b5-4430-afbf-c2630fc3e65d" path="/var/lib/kubelet/pods/4500796d-59b5-4430-afbf-c2630fc3e65d/volumes"
Jul 02 19:33:44.684126 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:44.684099    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:44.789684 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:44.789650    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" event={"ID":"3076547a-937c-4020-99e1-f56c22b17c69","Type":"ContainerStarted","Data":"3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399"}
Jul 02 19:33:45.013623 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:45.013590    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:45.014686 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:45.014659    2563 patch_prober.go:28] interesting pod/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:33:45.014803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:45.014716    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:33:46.013475 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:46.013443    2563 patch_prober.go:28] interesting pod/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:33:46.013901 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:46.013496    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:33:46.670133 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:46.670101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:33:47.013522 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:47.013438    2563 patch_prober.go:28] interesting pod/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:33:47.013522 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:47.013499    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:33:48.014518 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:48.014481    2563 patch_prober.go:28] interesting pod/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 02 19:33:48.014911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:48.014535    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 02 19:33:49.016965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:49.016938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:49.017436 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:49.017302    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:49.017936 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:49.017916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:49.187015 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:49.186984    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"]
Jul 02 19:33:49.813628 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:49.813593    2563 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" secret="" err="secret \"e2e-mt-f622a885-openshift-default-dockercfg-d5pgt\" not found"
Jul 02 19:33:50.817721 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:50.817687    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy" containerID="cri-o://3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399" gracePeriod=30
Jul 02 19:33:56.074486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.074461    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:56.137504 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137439    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-credential-socket\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137504 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137482    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-socket\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137505    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkfzj\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-kube-api-access-kkfzj\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137553    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-envoy\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-data\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3076547a-937c-4020-99e1-f56c22b17c69-istiod-ca-cert\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137651    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3076547a-937c-4020-99e1-f56c22b17c69-istio-podinfo\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-istio-token\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137996 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137729    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-certs\") pod \"3076547a-937c-4020-99e1-f56c22b17c69\" (UID: \"3076547a-937c-4020-99e1-f56c22b17c69\") "
Jul 02 19:33:56.137996 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137709    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:56.137996 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137775    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:56.137996 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.137972    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:56.138533 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.138062    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3076547a-937c-4020-99e1-f56c22b17c69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:33:56.138533 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.138081    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.138533 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.138224    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.138533 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.138244    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.138533 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.138512    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-data" (OuterVolumeSpecName: "istio-data") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:56.139882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.139863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3076547a-937c-4020-99e1-f56c22b17c69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:33:56.139882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.139871    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-istio-token" (OuterVolumeSpecName: "istio-token") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:33:56.140048 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.140031    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-kube-api-access-kkfzj" (OuterVolumeSpecName: "kube-api-access-kkfzj") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "kube-api-access-kkfzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:33:56.140162 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.140143    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3076547a-937c-4020-99e1-f56c22b17c69" (UID: "3076547a-937c-4020-99e1-f56c22b17c69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:56.239276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.239241    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkfzj\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-kube-api-access-kkfzj\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.239276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.239267    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.239276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.239276    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3076547a-937c-4020-99e1-f56c22b17c69-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.239486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.239284    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3076547a-937c-4020-99e1-f56c22b17c69-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.239486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.239292    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3076547a-937c-4020-99e1-f56c22b17c69-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.239486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.239299    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3076547a-937c-4020-99e1-f56c22b17c69-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:33:56.848281 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.848246    2563 generic.go:356] "Generic (PLEG): container finished" podID="3076547a-937c-4020-99e1-f56c22b17c69" containerID="3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399" exitCode=0
Jul 02 19:33:56.848470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.848296    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"
Jul 02 19:33:56.848470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.848333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" event={"ID":"3076547a-937c-4020-99e1-f56c22b17c69","Type":"ContainerDied","Data":"3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399"}
Jul 02 19:33:56.848470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.848397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9" event={"ID":"3076547a-937c-4020-99e1-f56c22b17c69","Type":"ContainerDied","Data":"da600fc880863a34c231b9a93f33d6e24c72315858b229eb4221a99c5f991b39"}
Jul 02 19:33:56.848470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.848430    2563 scope.go:117] "RemoveContainer" containerID="3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399"
Jul 02 19:33:56.860107 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.860084    2563 scope.go:117] "RemoveContainer" containerID="2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"
Jul 02 19:33:56.867794 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.867770    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"]
Jul 02 19:33:56.868246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.868229    2563 scope.go:117] "RemoveContainer" containerID="3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399"
Jul 02 19:33:56.868518 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:33:56.868499    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399\": container with ID starting with 3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399 not found: ID does not exist" containerID="3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399"
Jul 02 19:33:56.868606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.868531    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399"} err="failed to get container status \"3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399\": rpc error: code = NotFound desc = could not find container \"3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399\": container with ID starting with 3664ab1e223226f1a55f253408cb064d5234981f9eef31f4b8be434082c7c399 not found: ID does not exist"
Jul 02 19:33:56.868606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.868554    2563 scope.go:117] "RemoveContainer" containerID="2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"
Jul 02 19:33:56.868809 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:33:56.868784    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114\": container with ID starting with 2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114 not found: ID does not exist" containerID="2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"
Jul 02 19:33:56.868918 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.868812    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114"} err="failed to get container status \"2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114\": rpc error: code = NotFound desc = could not find container \"2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114\": container with ID starting with 2ddbfad3103507a37efb243d6714da0fa0b7241f5369ec09314144b2ae830114 not found: ID does not exist"
Jul 02 19:33:56.871739 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:56.871722    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f622a885-openshift-default-76f6d45479-vxrz9"]
Jul 02 19:33:58.495469 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:33:58.495437    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3076547a-937c-4020-99e1-f56c22b17c69" path="/var/lib/kubelet/pods/3076547a-937c-4020-99e1-f56c22b17c69/volumes"
Jul 02 19:34:08.704309 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704280    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"]
Jul 02 19:34:08.704691 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704637    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy"
Jul 02 19:34:08.704691 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704647    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy"
Jul 02 19:34:08.704691 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704657    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4500796d-59b5-4430-afbf-c2630fc3e65d" containerName="maas-api"
Jul 02 19:34:08.704691 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704663    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4500796d-59b5-4430-afbf-c2630fc3e65d" containerName="maas-api"
Jul 02 19:34:08.704821 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704726    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4500796d-59b5-4430-afbf-c2630fc3e65d" containerName="maas-api"
Jul 02 19:34:08.704821 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.704732    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy"
Jul 02 19:34:08.709148 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.709131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.711531 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.711507    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-65c4b835-openshift-default-dockercfg-kmvvn\""
Jul 02 19:34:08.720160 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.720138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"]
Jul 02 19:34:08.739827 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.739804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-credential-socket\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.739952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.739844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-token\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.739952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.739868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-envoy\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.740025 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.739946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-data\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.740025 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.740001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-certs\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.740096 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.740032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qrm\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-kube-api-access-c8qrm\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.740096 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.740066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-socket\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.740096 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.740084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95690de-87e6-447a-a0a5-caa7a66e5651-istiod-ca-cert\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.740216 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.740102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-podinfo\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-token\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841438 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-envoy\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841438 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841367    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-data\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841445    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-certs\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qrm\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-kube-api-access-c8qrm\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-socket\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95690de-87e6-447a-a0a5-caa7a66e5651-istiod-ca-cert\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841728 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-podinfo\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841728 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-credential-socket\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841752    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-data\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841897 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841861    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-certs\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.841980 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.841964    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-credential-socket\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.842041 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.842021    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-socket\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.842180 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.842165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95690de-87e6-447a-a0a5-caa7a66e5651-istiod-ca-cert\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.843646 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.843627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-envoy\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.843866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.843846    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-podinfo\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.855793 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.855750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-token\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:08.856191 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:08.856168    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qrm\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-kube-api-access-c8qrm\") pod \"e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") " pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:09.019473 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.019446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:09.158521 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.158494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"]
Jul 02 19:34:09.159703 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:34:09.159680    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95690de_87e6_447a_a0a5_caa7a66e5651.slice/crio-5100c2933eba68ec1daae7476740e940be4ed089616dc559fc5ec10012daa102 WatchSource:0}: Error finding container 5100c2933eba68ec1daae7476740e940be4ed089616dc559fc5ec10012daa102: Status 404 returned error can't find the container with id 5100c2933eba68ec1daae7476740e940be4ed089616dc559fc5ec10012daa102
Jul 02 19:34:09.161630 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.161594    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:34:09.161745 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.161666    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:34:09.161745 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.161712    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:34:09.923741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.923700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" event={"ID":"c95690de-87e6-447a-a0a5-caa7a66e5651","Type":"ContainerStarted","Data":"76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"}
Jul 02 19:34:09.924149 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.923802    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" event={"ID":"c95690de-87e6-447a-a0a5-caa7a66e5651","Type":"ContainerStarted","Data":"5100c2933eba68ec1daae7476740e940be4ed089616dc559fc5ec10012daa102"}
Jul 02 19:34:09.944788 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:09.944739    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podStartSLOduration=1.944724859 podStartE2EDuration="1.944724859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:34:09.942458004 +0000 UTC m=+1731.942594798" watchObservedRunningTime="2026-07-02 19:34:09.944724859 +0000 UTC m=+1731.944861652"
Jul 02 19:34:10.020120 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:10.020089    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:10.021704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:10.021674    2563 patch_prober.go:28] interesting pod/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:34:10.021826 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:10.021733    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:34:11.023528 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:11.023495    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:11.934487 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:11.934461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:11.935543 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:11.935526    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:12.060401 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.060364    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"]
Jul 02 19:34:12.060746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.060725    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy"
Jul 02 19:34:12.060746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.060739    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy"
Jul 02 19:34:12.060830 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.060818    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3076547a-937c-4020-99e1-f56c22b17c69" containerName="istio-proxy"
Jul 02 19:34:12.063999 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.063979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.067503 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.067484    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:34:12.067719 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.067704    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-65c4b835-serving-cert\""
Jul 02 19:34:12.076018 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.075995    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"]
Jul 02 19:34:12.174699 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.174664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.174997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.174719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6dvr\" (UniqueName: \"kubernetes.io/projected/e152d941-fce9-478a-9e5c-f299cb44447e-kube-api-access-p6dvr\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.174997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.174830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e152d941-fce9-478a-9e5c-f299cb44447e-openshift-service-ca\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.275964 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.275929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e152d941-fce9-478a-9e5c-f299cb44447e-openshift-service-ca\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.276159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.275996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.276159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.276030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6dvr\" (UniqueName: \"kubernetes.io/projected/e152d941-fce9-478a-9e5c-f299cb44447e-kube-api-access-p6dvr\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.276159 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:34:12.276116    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-65c4b835-serving-cert: secret "maas-api-e2e-mt-65c4b835-serving-cert" not found
Jul 02 19:34:12.276392 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:34:12.276193    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls podName:e152d941-fce9-478a-9e5c-f299cb44447e nodeName:}" failed. No retries permitted until 2026-07-02 19:34:12.776171834 +0000 UTC m=+1734.776308612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls") pod "maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" (UID: "e152d941-fce9-478a-9e5c-f299cb44447e") : secret "maas-api-e2e-mt-65c4b835-serving-cert" not found
Jul 02 19:34:12.276581 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.276562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e152d941-fce9-478a-9e5c-f299cb44447e-openshift-service-ca\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.291919 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.291894    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6dvr\" (UniqueName: \"kubernetes.io/projected/e152d941-fce9-478a-9e5c-f299cb44447e-kube-api-access-p6dvr\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.780488 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.780447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.783653 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.783626    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls\") pod \"maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") " pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:12.974987 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:12.974955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:13.110688 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:13.110663    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"]
Jul 02 19:34:13.112691 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:34:13.112661    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode152d941_fce9_478a_9e5c_f299cb44447e.slice/crio-807708313fedb09a7e33f0612f444d57278b0d1f55673922740f263d82d93afe WatchSource:0}: Error finding container 807708313fedb09a7e33f0612f444d57278b0d1f55673922740f263d82d93afe: Status 404 returned error can't find the container with id 807708313fedb09a7e33f0612f444d57278b0d1f55673922740f263d82d93afe
Jul 02 19:34:13.947334 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:13.947240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" event={"ID":"e152d941-fce9-478a-9e5c-f299cb44447e","Type":"ContainerStarted","Data":"8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343"}
Jul 02 19:34:13.947499 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:13.947338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" event={"ID":"e152d941-fce9-478a-9e5c-f299cb44447e","Type":"ContainerStarted","Data":"807708313fedb09a7e33f0612f444d57278b0d1f55673922740f263d82d93afe"}
Jul 02 19:34:13.947499 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:13.947439    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:13.971303 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:13.971254    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" podStartSLOduration=1.3950780649999999 podStartE2EDuration="1.971239093s" totalImagesPullingTime="576.161028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:34:13.968758411 +0000 UTC m=+1735.968895206" watchObservedRunningTime="2026-07-02 19:34:13.971239093 +0000 UTC m=+1735.971375886"
Jul 02 19:34:16.765476 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:16.765439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:34:19.958782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:19.958745    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:34:25.006782 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:25.006748    2563 generic.go:356] "Generic (PLEG): container finished" podID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerID="76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225" exitCode=0
Jul 02 19:34:25.007245 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:25.006789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" event={"ID":"c95690de-87e6-447a-a0a5-caa7a66e5651","Type":"ContainerDied","Data":"76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"}
Jul 02 19:34:25.007245 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:25.007132    2563 scope.go:117] "RemoveContainer" containerID="76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"
Jul 02 19:34:25.008121 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:25.008093    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:34:25.008172 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:25.008161    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:34:25.008240 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:25.008207    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:34:26.013358 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:26.013323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" event={"ID":"c95690de-87e6-447a-a0a5-caa7a66e5651","Type":"ContainerStarted","Data":"5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7"}
Jul 02 19:34:26.020249 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:26.020227    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:26.021397 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:26.021368    2563 patch_prober.go:28] interesting pod/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:34:26.021529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:26.021417    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:34:26.935092 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:26.935056    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:27.020633 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:27.020604    2563 patch_prober.go:28] interesting pod/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:34:27.021007 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:27.020657    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:34:28.020587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:28.020549    2563 patch_prober.go:28] interesting pod/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:34:28.020756 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:28.020629    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:34:29.019917 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:29.019881    2563 patch_prober.go:28] interesting pod/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 02 19:34:29.020134 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:29.019946    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 02 19:34:30.024309 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:30.024280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:30.025281 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:30.025261    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:34:42.966893 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:42.966862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:34:59.160623 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:34:59.160582    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:35:04.843496 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:04.843461    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"]
Jul 02 19:35:04.843975 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:04.843670    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" podUID="e152d941-fce9-478a-9e5c-f299cb44447e" containerName="maas-api" containerID="cri-o://8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343" gracePeriod=30
Jul 02 19:35:04.953931 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:04.953892    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" podUID="e152d941-fce9-478a-9e5c-f299cb44447e" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.43:8443/health\": dial tcp 10.132.0.43:8443: connect: connection refused"
Jul 02 19:35:05.094256 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.094161    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:35:05.158327 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.158295    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e152d941-fce9-478a-9e5c-f299cb44447e-openshift-service-ca\") pod \"e152d941-fce9-478a-9e5c-f299cb44447e\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") "
Jul 02 19:35:05.158495 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.158361    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6dvr\" (UniqueName: \"kubernetes.io/projected/e152d941-fce9-478a-9e5c-f299cb44447e-kube-api-access-p6dvr\") pod \"e152d941-fce9-478a-9e5c-f299cb44447e\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") "
Jul 02 19:35:05.158495 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.158472    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls\") pod \"e152d941-fce9-478a-9e5c-f299cb44447e\" (UID: \"e152d941-fce9-478a-9e5c-f299cb44447e\") "
Jul 02 19:35:05.158713 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.158690    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e152d941-fce9-478a-9e5c-f299cb44447e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e152d941-fce9-478a-9e5c-f299cb44447e" (UID: "e152d941-fce9-478a-9e5c-f299cb44447e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:35:05.160515 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.160490    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e152d941-fce9-478a-9e5c-f299cb44447e-kube-api-access-p6dvr" (OuterVolumeSpecName: "kube-api-access-p6dvr") pod "e152d941-fce9-478a-9e5c-f299cb44447e" (UID: "e152d941-fce9-478a-9e5c-f299cb44447e"). InnerVolumeSpecName "kube-api-access-p6dvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:35:05.160620 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.160484    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e152d941-fce9-478a-9e5c-f299cb44447e" (UID: "e152d941-fce9-478a-9e5c-f299cb44447e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:35:05.232362 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.232336    2563 generic.go:356] "Generic (PLEG): container finished" podID="e152d941-fce9-478a-9e5c-f299cb44447e" containerID="8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343" exitCode=0
Jul 02 19:35:05.232505 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.232371    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"
Jul 02 19:35:05.232505 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.232372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" event={"ID":"e152d941-fce9-478a-9e5c-f299cb44447e","Type":"ContainerDied","Data":"8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343"}
Jul 02 19:35:05.232505 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.232440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v" event={"ID":"e152d941-fce9-478a-9e5c-f299cb44447e","Type":"ContainerDied","Data":"807708313fedb09a7e33f0612f444d57278b0d1f55673922740f263d82d93afe"}
Jul 02 19:35:05.232505 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.232471    2563 scope.go:117] "RemoveContainer" containerID="8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343"
Jul 02 19:35:05.241865 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.241847    2563 scope.go:117] "RemoveContainer" containerID="8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343"
Jul 02 19:35:05.242093 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:35:05.242076    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343\": container with ID starting with 8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343 not found: ID does not exist" containerID="8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343"
Jul 02 19:35:05.242160 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.242104    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343"} err="failed to get container status \"8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343\": rpc error: code = NotFound desc = could not find container \"8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343\": container with ID starting with 8bee6438a6d4e084dee0e709966ee8f15314fa038b0b0b2eb200a2fd4b2f6343 not found: ID does not exist"
Jul 02 19:35:05.256185 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.256154    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"]
Jul 02 19:35:05.259279 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.259257    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e152d941-fce9-478a-9e5c-f299cb44447e-openshift-service-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:35:05.259279 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.259278    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6dvr\" (UniqueName: \"kubernetes.io/projected/e152d941-fce9-478a-9e5c-f299cb44447e-kube-api-access-p6dvr\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:35:05.259442 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.259288    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e152d941-fce9-478a-9e5c-f299cb44447e-maas-api-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:35:05.260244 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:05.260226    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-65c4b835-6b4cc76fbd-2mk5v"]
Jul 02 19:35:06.495372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:06.495339    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e152d941-fce9-478a-9e5c-f299cb44447e" path="/var/lib/kubelet/pods/e152d941-fce9-478a-9e5c-f299cb44447e/volumes"
Jul 02 19:35:08.764532 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:08.764505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:35:18.500368 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:18.500339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:35:18.502882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:18.502857    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:35:18.506207 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:18.506177    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:35:18.508741 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:18.508724    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:35:19.560727 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:19.560696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:35:55.065956 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:35:55.065918    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:36:04.153766 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:04.153730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"]
Jul 02 19:36:04.154191 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:04.153921    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy" containerID="cri-o://5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7" gracePeriod=30
Jul 02 19:36:07.860928 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:07.860894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:36:09.407300 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.407275    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:36:09.504379 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504312    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-token\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504379 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504339    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-data\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504379 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504367    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-certs\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504387    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-socket\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8qrm\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-kube-api-access-c8qrm\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-podinfo\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-envoy\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504551    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95690de-87e6-447a-a0a5-caa7a66e5651-istiod-ca-cert\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504581    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-credential-socket\") pod \"c95690de-87e6-447a-a0a5-caa7a66e5651\" (UID: \"c95690de-87e6-447a-a0a5-caa7a66e5651\") "
Jul 02 19:36:09.504662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504640    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:09.505017 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504713    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:09.505017 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504922    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:09.505017 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504930    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.505017 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504963    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.505017 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.504990    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c95690de-87e6-447a-a0a5-caa7a66e5651-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:36:09.505394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.505372    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-data" (OuterVolumeSpecName: "istio-data") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:09.506618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.506594    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:36:09.506696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.506656    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:09.506886 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.506871    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-token" (OuterVolumeSpecName: "istio-token") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:09.506968 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.506950    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-kube-api-access-c8qrm" (OuterVolumeSpecName: "kube-api-access-c8qrm") pod "c95690de-87e6-447a-a0a5-caa7a66e5651" (UID: "c95690de-87e6-447a-a0a5-caa7a66e5651"). InnerVolumeSpecName "kube-api-access-c8qrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:09.546481 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.546451    2563 generic.go:356] "Generic (PLEG): container finished" podID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerID="5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7" exitCode=0
Jul 02 19:36:09.546603 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.546513    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"
Jul 02 19:36:09.546603 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.546527    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" event={"ID":"c95690de-87e6-447a-a0a5-caa7a66e5651","Type":"ContainerDied","Data":"5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7"}
Jul 02 19:36:09.546603 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.546578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6" event={"ID":"c95690de-87e6-447a-a0a5-caa7a66e5651","Type":"ContainerDied","Data":"5100c2933eba68ec1daae7476740e940be4ed089616dc559fc5ec10012daa102"}
Jul 02 19:36:09.546603 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.546599    2563 scope.go:117] "RemoveContainer" containerID="5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7"
Jul 02 19:36:09.555565 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.555549    2563 scope.go:117] "RemoveContainer" containerID="76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"
Jul 02 19:36:09.563296 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.563269    2563 scope.go:117] "RemoveContainer" containerID="5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7"
Jul 02 19:36:09.563566 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:36:09.563547    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7\": container with ID starting with 5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7 not found: ID does not exist" containerID="5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7"
Jul 02 19:36:09.563647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.563571    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7"} err="failed to get container status \"5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7\": rpc error: code = NotFound desc = could not find container \"5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7\": container with ID starting with 5172b5aad9459fad3ded86fbf2391512390b3d88863251ed83d2ed167d181ed7 not found: ID does not exist"
Jul 02 19:36:09.563647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.563587    2563 scope.go:117] "RemoveContainer" containerID="76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"
Jul 02 19:36:09.563825 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:36:09.563805    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225\": container with ID starting with 76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225 not found: ID does not exist" containerID="76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"
Jul 02 19:36:09.563874 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.563832    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225"} err="failed to get container status \"76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225\": rpc error: code = NotFound desc = could not find container \"76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225\": container with ID starting with 76bf25c909b89192d00a0204d48789704478a4ea6391d461b1a453732165e225 not found: ID does not exist"
Jul 02 19:36:09.568963 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.568943    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"]
Jul 02 19:36:09.574906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.574885    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-65c4b835-openshift-default-8b899487f-tn9m6"]
Jul 02 19:36:09.605854 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605834    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.605854 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605853    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.605970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605862    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c95690de-87e6-447a-a0a5-caa7a66e5651-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.605970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605869    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.605970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605878    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.605970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605886    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c95690de-87e6-447a-a0a5-caa7a66e5651-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:09.605970 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:09.605896    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8qrm\" (UniqueName: \"kubernetes.io/projected/c95690de-87e6-447a-a0a5-caa7a66e5651-kube-api-access-c8qrm\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:36:10.495615 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:10.495580    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" path="/var/lib/kubelet/pods/c95690de-87e6-447a-a0a5-caa7a66e5651/volumes"
Jul 02 19:36:19.464497 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:19.464461    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:36:59.544243 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544154    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"]
Jul 02 19:36:59.544643 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544602    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy"
Jul 02 19:36:59.544643 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544615    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy"
Jul 02 19:36:59.544643 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544630    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy"
Jul 02 19:36:59.544643 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544636    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy"
Jul 02 19:36:59.544771 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544649    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e152d941-fce9-478a-9e5c-f299cb44447e" containerName="maas-api"
Jul 02 19:36:59.544771 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544655    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e152d941-fce9-478a-9e5c-f299cb44447e" containerName="maas-api"
Jul 02 19:36:59.544771 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544706    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e152d941-fce9-478a-9e5c-f299cb44447e" containerName="maas-api"
Jul 02 19:36:59.544771 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.544716    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy"
Jul 02 19:36:59.548008 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.547987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.550319 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.550302    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ef1ca5-openshift-default-dockercfg-nw8pn\""
Jul 02 19:36:59.562352 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.562323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"]
Jul 02 19:36:59.649545 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-credential-socket\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-envoy\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-data\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsrtd\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-kube-api-access-jsrtd\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-certs\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-token\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649976 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-podinfo\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649976 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-socket\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.649976 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.649865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31ed840b-aba3-4356-8196-0f45bd15b2ec-istiod-ca-cert\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751117 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751088    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsrtd\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-kube-api-access-jsrtd\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751320 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-certs\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751320 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-token\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751320 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-podinfo\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751320 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-socket\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751320 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31ed840b-aba3-4356-8196-0f45bd15b2ec-istiod-ca-cert\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751596 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-credential-socket\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751716 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-credential-socket\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-envoy\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751625    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-socket\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751569    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-certs\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.751838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.751747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-data\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.752024 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.752003    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-data\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.752064 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.752007    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31ed840b-aba3-4356-8196-0f45bd15b2ec-istiod-ca-cert\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.753611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.753588    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-podinfo\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.753696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.753644    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-envoy\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.758752 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.758727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-token\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.758915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.758900    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsrtd\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-kube-api-access-jsrtd\") pod \"e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") " pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.858241 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.858151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:36:59.992436 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.992412    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"]
Jul 02 19:36:59.994114 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:36:59.994092    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ed840b_aba3_4356_8196_0f45bd15b2ec.slice/crio-55fdaef95c0cc49971629b66043fc17335fb04a872e40761d2debbb8366db4e5 WatchSource:0}: Error finding container 55fdaef95c0cc49971629b66043fc17335fb04a872e40761d2debbb8366db4e5: Status 404 returned error can't find the container with id 55fdaef95c0cc49971629b66043fc17335fb04a872e40761d2debbb8366db4e5
Jul 02 19:36:59.996110 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.996078    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:36:59.996225 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.996161    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:36:59.996295 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:36:59.996225    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:00.795308 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:00.795272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" event={"ID":"31ed840b-aba3-4356-8196-0f45bd15b2ec","Type":"ContainerStarted","Data":"f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"}
Jul 02 19:37:00.795723 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:00.795322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" event={"ID":"31ed840b-aba3-4356-8196-0f45bd15b2ec","Type":"ContainerStarted","Data":"55fdaef95c0cc49971629b66043fc17335fb04a872e40761d2debbb8366db4e5"}
Jul 02 19:37:00.818211 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:00.818154    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podStartSLOduration=1.818140164 podStartE2EDuration="1.818140164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:00.816084397 +0000 UTC m=+1902.816221191" watchObservedRunningTime="2026-07-02 19:37:00.818140164 +0000 UTC m=+1902.818276958"
Jul 02 19:37:00.858518 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:00.858491    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:01.863675 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:01.863642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:02.805270 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.805236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:02.806021 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.806003    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:02.916339 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.916307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"]
Jul 02 19:37:02.916976 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.916958    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95690de-87e6-447a-a0a5-caa7a66e5651" containerName="istio-proxy"
Jul 02 19:37:02.920631 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.920611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:02.931226 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.923644    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:37:02.931226 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.925596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-ef1ca5-serving-cert\""
Jul 02 19:37:02.934913 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:02.934891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"]
Jul 02 19:37:03.078699 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.078619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.078699 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.078672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0d5ab96-c87c-4b16-9537-e6184640eea9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.078915 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.078746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkbd7\" (UniqueName: \"kubernetes.io/projected/a0d5ab96-c87c-4b16-9537-e6184640eea9-kube-api-access-wkbd7\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.179812 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.179780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.179966 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.179827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0d5ab96-c87c-4b16-9537-e6184640eea9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.179966 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.179856    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkbd7\" (UniqueName: \"kubernetes.io/projected/a0d5ab96-c87c-4b16-9537-e6184640eea9-kube-api-access-wkbd7\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.179966 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:37:03.179935    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-ef1ca5-serving-cert: secret "maas-api-e2e-inf-a-ef1ca5-serving-cert" not found
Jul 02 19:37:03.180072 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:37:03.180004    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls podName:a0d5ab96-c87c-4b16-9537-e6184640eea9 nodeName:}" failed. No retries permitted until 2026-07-02 19:37:03.679985454 +0000 UTC m=+1905.680122247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls") pod "maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" (UID: "a0d5ab96-c87c-4b16-9537-e6184640eea9") : secret "maas-api-e2e-inf-a-ef1ca5-serving-cert" not found
Jul 02 19:37:03.180418 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.180400    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0d5ab96-c87c-4b16-9537-e6184640eea9-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.188719 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.188693    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkbd7\" (UniqueName: \"kubernetes.io/projected/a0d5ab96-c87c-4b16-9537-e6184640eea9-kube-api-access-wkbd7\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.684446 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.684411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.687006 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.686977    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls\") pod \"maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") " pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:03.843036 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:03.843009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:04.007910 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:04.007883    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"]
Jul 02 19:37:04.009681 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:37:04.009657    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d5ab96_c87c_4b16_9537_e6184640eea9.slice/crio-9ff591c16e58ad153fcf9d414e5a551daa03c607ed3fde9e7e554f7f716ad709 WatchSource:0}: Error finding container 9ff591c16e58ad153fcf9d414e5a551daa03c607ed3fde9e7e554f7f716ad709: Status 404 returned error can't find the container with id 9ff591c16e58ad153fcf9d414e5a551daa03c607ed3fde9e7e554f7f716ad709
Jul 02 19:37:04.011351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:04.011330    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:37:04.815956 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:04.815920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" event={"ID":"a0d5ab96-c87c-4b16-9537-e6184640eea9","Type":"ContainerStarted","Data":"f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915"}
Jul 02 19:37:04.816153 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:04.815977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" event={"ID":"a0d5ab96-c87c-4b16-9537-e6184640eea9","Type":"ContainerStarted","Data":"9ff591c16e58ad153fcf9d414e5a551daa03c607ed3fde9e7e554f7f716ad709"}
Jul 02 19:37:04.832091 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:04.832044    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" podStartSLOduration=2.34155615 podStartE2EDuration="2.832025638s" totalImagesPullingTime="490.469488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:04.831756725 +0000 UTC m=+1906.831893521" watchObservedRunningTime="2026-07-02 19:37:04.832025638 +0000 UTC m=+1906.832162434"
Jul 02 19:37:05.821389 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:05.821359    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:07.992996 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:07.992966    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"]
Jul 02 19:37:07.997437 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:07.997417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.000016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:07.999995    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4ae35c-openshift-default-dockercfg-bcmmm\""
Jul 02 19:37:08.007961 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.007938    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"]
Jul 02 19:37:08.123105 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf96f75e-2978-4d12-a627-abd233d006b2-istiod-ca-cert\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123337 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-envoy\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123337 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-certs\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123337 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-data\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123337 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf96f75e-2978-4d12-a627-abd233d006b2-istio-podinfo\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123337 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-credential-socket\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123578 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-istio-token\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123578 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbl2j\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-kube-api-access-dbl2j\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.123578 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.123440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-socket\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224532 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf96f75e-2978-4d12-a627-abd233d006b2-istiod-ca-cert\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-envoy\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-certs\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-data\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf96f75e-2978-4d12-a627-abd233d006b2-istio-podinfo\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-credential-socket\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-istio-token\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.224725 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbl2j\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-kube-api-access-dbl2j\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.225067 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.224764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-socket\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.225067 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.225011    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-data\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.225171 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.225137    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-credential-socket\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.225261 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.225246    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-socket\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.225324 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.225283    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-certs\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.225363 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.225344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf96f75e-2978-4d12-a627-abd233d006b2-istiod-ca-cert\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.226855 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.226835    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-envoy\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.227158 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.227140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf96f75e-2978-4d12-a627-abd233d006b2-istio-podinfo\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.232525 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.232507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-istio-token\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.232732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.232716    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbl2j\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-kube-api-access-dbl2j\") pod \"e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") " pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.309193 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.309169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:08.452279 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.452254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"]
Jul 02 19:37:08.454070 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:37:08.454046    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf96f75e_2978_4d12_a627_abd233d006b2.slice/crio-d2c3696950f252c4976203ca37433f91e6cc6c9972cd86f4c33975822b0dc057 WatchSource:0}: Error finding container d2c3696950f252c4976203ca37433f91e6cc6c9972cd86f4c33975822b0dc057: Status 404 returned error can't find the container with id d2c3696950f252c4976203ca37433f91e6cc6c9972cd86f4c33975822b0dc057
Jul 02 19:37:08.456730 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.456700    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:08.456803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.456767    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:08.456803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.456799    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:08.837913 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.837880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" event={"ID":"bf96f75e-2978-4d12-a627-abd233d006b2","Type":"ContainerStarted","Data":"f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"}
Jul 02 19:37:08.838149 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.837930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" event={"ID":"bf96f75e-2978-4d12-a627-abd233d006b2","Type":"ContainerStarted","Data":"d2c3696950f252c4976203ca37433f91e6cc6c9972cd86f4c33975822b0dc057"}
Jul 02 19:37:08.856972 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:08.856929    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" podStartSLOduration=1.856914308 podStartE2EDuration="1.856914308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:37:08.855270038 +0000 UTC m=+1910.855406833" watchObservedRunningTime="2026-07-02 19:37:08.856914308 +0000 UTC m=+1910.857051103"
Jul 02 19:37:09.310162 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:09.310134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:09.314983 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:09.314963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:09.665092 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:09.664999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:37:09.845356 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:09.845321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:09.846486 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:09.846465    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:11.837581 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:11.837539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:37:17.807172 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.807136    2563 patch_prober.go:28] interesting pod/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 02 19:37:17.807608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.807222    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 02 19:37:17.890427 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.890352    2563 generic.go:356] "Generic (PLEG): container finished" podID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerID="f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8" exitCode=0
Jul 02 19:37:17.890569 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.890421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" event={"ID":"31ed840b-aba3-4356-8196-0f45bd15b2ec","Type":"ContainerDied","Data":"f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"}
Jul 02 19:37:17.890826 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.890810    2563 scope.go:117] "RemoveContainer" containerID="f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"
Jul 02 19:37:17.891890 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.891861    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:17.891975 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.891928    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:17.891975 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:17.891958    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:18.897022 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:18.896986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" event={"ID":"31ed840b-aba3-4356-8196-0f45bd15b2ec","Type":"ContainerStarted","Data":"79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79"}
Jul 02 19:37:19.764772 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:19.764711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:37:19.859441 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:19.859407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:19.859792 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:19.859766    2563 patch_prober.go:28] interesting pod/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 02 19:37:19.859960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:19.859932    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 02 19:37:20.859076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:20.859035    2563 patch_prober.go:28] interesting pod/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 02 19:37:20.859476 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:20.859101    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 02 19:37:21.858836 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:21.858765    2563 patch_prober.go:28] interesting pod/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 02 19:37:21.859016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:21.858851    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 02 19:37:22.862778 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:22.862750    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:22.863166 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:22.863026    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:22.863840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:22.863822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:37:23.927363 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:23.927332    2563 generic.go:356] "Generic (PLEG): container finished" podID="bf96f75e-2978-4d12-a627-abd233d006b2" containerID="f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c" exitCode=0
Jul 02 19:37:23.927768 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:23.927408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" event={"ID":"bf96f75e-2978-4d12-a627-abd233d006b2","Type":"ContainerDied","Data":"f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"}
Jul 02 19:37:23.927887 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:23.927872    2563 scope.go:117] "RemoveContainer" containerID="f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"
Jul 02 19:37:23.928781 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:23.928755    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:23.928830 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:23.928822    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:23.928883 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:23.928872    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:37:24.846137 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:24.846096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:24.938225 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:24.938154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" event={"ID":"bf96f75e-2978-4d12-a627-abd233d006b2","Type":"ContainerStarted","Data":"4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9"}
Jul 02 19:37:25.309579 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:25.309537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:25.310789 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:25.310767    2563 patch_prober.go:28] interesting pod/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:37:25.310864 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:25.310816    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:37:26.310091 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:26.310059    2563 patch_prober.go:28] interesting pod/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:37:26.310502 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:26.310121    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:37:27.309883 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:27.309848    2563 patch_prober.go:28] interesting pod/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:37:27.310059 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:27.309904    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:37:28.310583 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:28.310549    2563 patch_prober.go:28] interesting pod/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 02 19:37:28.310956 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:28.310604    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 02 19:37:29.261026 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:29.260990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:37:29.313827 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:29.313799    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:29.314247 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:29.314073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:29.314701 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:29.314685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:37:52.060849 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:37:52.060815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:38:04.566104 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:04.566049    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:38:10.697460 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.697369    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"]
Jul 02 19:38:10.697937 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.697620    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" podUID="a0d5ab96-c87c-4b16-9537-e6184640eea9" containerName="maas-api" containerID="cri-o://f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915" gracePeriod=30
Jul 02 19:38:10.954333 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.951470    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:38:10.985658 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.985627    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0d5ab96-c87c-4b16-9537-e6184640eea9-openshift-service-ca\") pod \"a0d5ab96-c87c-4b16-9537-e6184640eea9\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") "
Jul 02 19:38:10.985818 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.985696    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkbd7\" (UniqueName: \"kubernetes.io/projected/a0d5ab96-c87c-4b16-9537-e6184640eea9-kube-api-access-wkbd7\") pod \"a0d5ab96-c87c-4b16-9537-e6184640eea9\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") "
Jul 02 19:38:10.985818 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.985770    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls\") pod \"a0d5ab96-c87c-4b16-9537-e6184640eea9\" (UID: \"a0d5ab96-c87c-4b16-9537-e6184640eea9\") "
Jul 02 19:38:10.986050 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.985996    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d5ab96-c87c-4b16-9537-e6184640eea9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a0d5ab96-c87c-4b16-9537-e6184640eea9" (UID: "a0d5ab96-c87c-4b16-9537-e6184640eea9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:38:10.987906 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.987881    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a0d5ab96-c87c-4b16-9537-e6184640eea9" (UID: "a0d5ab96-c87c-4b16-9537-e6184640eea9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:38:10.988026 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:10.987952    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d5ab96-c87c-4b16-9537-e6184640eea9-kube-api-access-wkbd7" (OuterVolumeSpecName: "kube-api-access-wkbd7") pod "a0d5ab96-c87c-4b16-9537-e6184640eea9" (UID: "a0d5ab96-c87c-4b16-9537-e6184640eea9"). InnerVolumeSpecName "kube-api-access-wkbd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:38:11.087275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.087237    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0d5ab96-c87c-4b16-9537-e6184640eea9-openshift-service-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.087275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.087268    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkbd7\" (UniqueName: \"kubernetes.io/projected/a0d5ab96-c87c-4b16-9537-e6184640eea9-kube-api-access-wkbd7\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.087275 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.087283    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0d5ab96-c87c-4b16-9537-e6184640eea9-maas-api-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:11.175358 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.175308    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0d5ab96-c87c-4b16-9537-e6184640eea9" containerID="f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915" exitCode=0
Jul 02 19:38:11.175571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.175346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" event={"ID":"a0d5ab96-c87c-4b16-9537-e6184640eea9","Type":"ContainerDied","Data":"f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915"}
Jul 02 19:38:11.175571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.175371    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"
Jul 02 19:38:11.175571 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.175530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh" event={"ID":"a0d5ab96-c87c-4b16-9537-e6184640eea9","Type":"ContainerDied","Data":"9ff591c16e58ad153fcf9d414e5a551daa03c607ed3fde9e7e554f7f716ad709"}
Jul 02 19:38:11.175790 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.175590    2563 scope.go:117] "RemoveContainer" containerID="f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915"
Jul 02 19:38:11.185978 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.185953    2563 scope.go:117] "RemoveContainer" containerID="f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915"
Jul 02 19:38:11.186285 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:38:11.186264    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915\": container with ID starting with f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915 not found: ID does not exist" containerID="f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915"
Jul 02 19:38:11.186356 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.186293    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915"} err="failed to get container status \"f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915\": rpc error: code = NotFound desc = could not find container \"f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915\": container with ID starting with f0a2acfb9ec641559ea1c953a60e081af85383b4f97a6e6f7797287ca8478915 not found: ID does not exist"
Jul 02 19:38:11.196156 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.196132    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"]
Jul 02 19:38:11.199770 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:11.199749    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-ef1ca5-7457b85987-cvtzh"]
Jul 02 19:38:12.494937 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:12.494906    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0d5ab96-c87c-4b16-9537-e6184640eea9" path="/var/lib/kubelet/pods/a0d5ab96-c87c-4b16-9537-e6184640eea9/volumes"
Jul 02 19:38:15.861082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:15.861045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:38:52.497105 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:52.497072    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"]
Jul 02 19:38:52.497606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:52.497357    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy" containerID="cri-o://79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79" gracePeriod=30
Jul 02 19:38:52.865776 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:52.865740    2563 patch_prober.go:28] interesting pod/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 02 19:38:52.865941 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:52.865808    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 19:38:56.271405 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:56.271353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:38:57.745706 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.745685    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:38:57.885798 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885771    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-data\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.885965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-podinfo\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.885965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885865    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-envoy\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.885965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsrtd\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-kube-api-access-jsrtd\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.885965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-certs\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.885965 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885915    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-token\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.886265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885970    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31ed840b-aba3-4356-8196-0f45bd15b2ec-istiod-ca-cert\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.886265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.885995    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-socket\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.886265 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.886025    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-credential-socket\") pod \"31ed840b-aba3-4356-8196-0f45bd15b2ec\" (UID: \"31ed840b-aba3-4356-8196-0f45bd15b2ec\") "
Jul 02 19:38:57.886492 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.886285    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:57.886492 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.886474    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:57.886605 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.886487    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:57.886757 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.886728    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31ed840b-aba3-4356-8196-0f45bd15b2ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:38:57.886847 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.886794    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:57.888126 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.888106    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-kube-api-access-jsrtd" (OuterVolumeSpecName: "kube-api-access-jsrtd") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "kube-api-access-jsrtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:38:57.888251 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.888148    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:38:57.888512 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.888492    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:38:57.888617 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.888595    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "31ed840b-aba3-4356-8196-0f45bd15b2ec" (UID: "31ed840b-aba3-4356-8196-0f45bd15b2ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:38:57.986831 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986799    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.986831 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986825    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.986831 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986835    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.987054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986843    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsrtd\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-kube-api-access-jsrtd\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.987054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986853    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.987054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986860    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31ed840b-aba3-4356-8196-0f45bd15b2ec-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.987054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986868    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31ed840b-aba3-4356-8196-0f45bd15b2ec-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.987054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986875    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:57.987054 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:57.986883    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31ed840b-aba3-4356-8196-0f45bd15b2ec-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:38:58.422383 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.422353    2563 generic.go:356] "Generic (PLEG): container finished" podID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerID="79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79" exitCode=0
Jul 02 19:38:58.422534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.422405    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"
Jul 02 19:38:58.422534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.422443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" event={"ID":"31ed840b-aba3-4356-8196-0f45bd15b2ec","Type":"ContainerDied","Data":"79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79"}
Jul 02 19:38:58.422534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.422505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf" event={"ID":"31ed840b-aba3-4356-8196-0f45bd15b2ec","Type":"ContainerDied","Data":"55fdaef95c0cc49971629b66043fc17335fb04a872e40761d2debbb8366db4e5"}
Jul 02 19:38:58.422534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.422533    2563 scope.go:117] "RemoveContainer" containerID="79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79"
Jul 02 19:38:58.431867 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.431852    2563 scope.go:117] "RemoveContainer" containerID="f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"
Jul 02 19:38:58.439831 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.439817    2563 scope.go:117] "RemoveContainer" containerID="79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79"
Jul 02 19:38:58.440057 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:38:58.440036    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79\": container with ID starting with 79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79 not found: ID does not exist" containerID="79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79"
Jul 02 19:38:58.440120 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.440064    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79"} err="failed to get container status \"79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79\": rpc error: code = NotFound desc = could not find container \"79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79\": container with ID starting with 79df979bf2f1baec24a041659c95b5bf83e26541fcd824fb7dbc99dea25a1f79 not found: ID does not exist"
Jul 02 19:38:58.440120 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.440079    2563 scope.go:117] "RemoveContainer" containerID="f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"
Jul 02 19:38:58.440377 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:38:58.440359    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8\": container with ID starting with f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8 not found: ID does not exist" containerID="f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"
Jul 02 19:38:58.440435 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.440380    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8"} err="failed to get container status \"f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8\": rpc error: code = NotFound desc = could not find container \"f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8\": container with ID starting with f2fe3d86e95b0d55a88afbcc4bf652f8fc88c02212e77c2c6ccf4ab7c4655bb8 not found: ID does not exist"
Jul 02 19:38:58.444833 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.444809    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"]
Jul 02 19:38:58.449096 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.449074    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ef1ca5-openshift-default-64f54dcf9-qjqlf"]
Jul 02 19:38:58.499254 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:58.499225    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" path="/var/lib/kubelet/pods/31ed840b-aba3-4356-8196-0f45bd15b2ec/volumes"
Jul 02 19:38:59.350817 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:59.350786    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"]
Jul 02 19:38:59.351246 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:38:59.350994    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy" containerID="cri-o://4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9" gracePeriod=30
Jul 02 19:39:00.253100 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253063    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"]
Jul 02 19:39:00.253497 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253473    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy"
Jul 02 19:39:00.253497 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253497    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy"
Jul 02 19:39:00.253662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253510    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d5ab96-c87c-4b16-9537-e6184640eea9" containerName="maas-api"
Jul 02 19:39:00.253662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253521    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d5ab96-c87c-4b16-9537-e6184640eea9" containerName="maas-api"
Jul 02 19:39:00.253662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253650    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy"
Jul 02 19:39:00.253773 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.253662    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0d5ab96-c87c-4b16-9537-e6184640eea9" containerName="maas-api"
Jul 02 19:39:00.257990 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.257971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.260088 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.260068    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c8695a-openshift-default-dockercfg-8zbjc\""
Jul 02 19:39:00.267546 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.267522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"]
Jul 02 19:39:00.410938 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.410905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-data\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.410938 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.410938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istiod-ca-cert\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.410978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-envoy\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.411061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vxd\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-kube-api-access-x9vxd\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.411158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-token\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.411223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-socket\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.411277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-credential-socket\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.411330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-certs\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.411451 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.411346    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-podinfo\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512152 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-socket\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512152 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-credential-socket\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-certs\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-podinfo\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-data\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istiod-ca-cert\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-envoy\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512410 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vxd\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-kube-api-access-x9vxd\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512737 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-token\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512737 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512560    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-credential-socket\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512737 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512571    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-socket\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512737 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512592    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-certs\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.512969 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.512766    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-data\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.513328 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.513310    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istiod-ca-cert\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.515052 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.515025    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-envoy\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.515386 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.515364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-podinfo\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.520374 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.520349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-token\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.520958 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.520937    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vxd\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-kube-api-access-x9vxd\") pod \"e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") " pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.569222 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.569168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:00.706339 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.706312    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"]
Jul 02 19:39:00.708190 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:39:00.708160    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5c4492_0392_4efd_ba83_80c6dfd5f66f.slice/crio-095199edc0a7ffa94d132fe567f796d41a75a12833336b9f8b337ba0fbeee47e WatchSource:0}: Error finding container 095199edc0a7ffa94d132fe567f796d41a75a12833336b9f8b337ba0fbeee47e: Status 404 returned error can't find the container with id 095199edc0a7ffa94d132fe567f796d41a75a12833336b9f8b337ba0fbeee47e
Jul 02 19:39:00.710292 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.710261    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:00.710375 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.710323    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:00.710375 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:00.710354    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:01.440648 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:01.440612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" event={"ID":"5d5c4492-0392-4efd-ba83-80c6dfd5f66f","Type":"ContainerStarted","Data":"5f3052a9948c08e56088294da4653ec6653a82d9799381e0b6c5806f958b55e5"}
Jul 02 19:39:01.441051 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:01.440693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" event={"ID":"5d5c4492-0392-4efd-ba83-80c6dfd5f66f","Type":"ContainerStarted","Data":"095199edc0a7ffa94d132fe567f796d41a75a12833336b9f8b337ba0fbeee47e"}
Jul 02 19:39:01.460325 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:01.460280    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podStartSLOduration=1.460265214 podStartE2EDuration="1.460265214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:01.458282689 +0000 UTC m=+2023.458419486" watchObservedRunningTime="2026-07-02 19:39:01.460265214 +0000 UTC m=+2023.460402007"
Jul 02 19:39:01.569860 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:01.569816    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:01.575946 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:01.575919    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:02.445930 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:02.445900    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:02.446913 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:02.446893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:04.611304 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.611185    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:39:04.641036 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.640996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf96f75e-2978-4d12-a627-abd233d006b2-istio-podinfo\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641036 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-certs\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641331 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641049    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-data\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641331 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641249    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-credential-socket\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641339    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbl2j\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-kube-api-access-dbl2j\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641356    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:04.641459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641364    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-socket\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641459 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-envoy\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641683 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-istio-token\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641683 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641494    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:04.641683 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641528    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf96f75e-2978-4d12-a627-abd233d006b2-istiod-ca-cert\") pod \"bf96f75e-2978-4d12-a627-abd233d006b2\" (UID: \"bf96f75e-2978-4d12-a627-abd233d006b2\") "
Jul 02 19:39:04.641683 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641568    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:04.641887 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641788    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.641887 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641803    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.641887 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641816    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.641887 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.641878    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:04.642089 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.642029    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf96f75e-2978-4d12-a627-abd233d006b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:39:04.643324 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.643300    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf96f75e-2978-4d12-a627-abd233d006b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:39:04.643561 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.643544    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:04.643943 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.643916    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:04.643943 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.643923    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-kube-api-access-dbl2j" (OuterVolumeSpecName: "kube-api-access-dbl2j") pod "bf96f75e-2978-4d12-a627-abd233d006b2" (UID: "bf96f75e-2978-4d12-a627-abd233d006b2"). InnerVolumeSpecName "kube-api-access-dbl2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:04.742880 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.742839    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbl2j\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-kube-api-access-dbl2j\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.742880 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.742871    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.742880 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.742882    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf96f75e-2978-4d12-a627-abd233d006b2-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.742880 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.742890    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf96f75e-2978-4d12-a627-abd233d006b2-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.743150 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.742898    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf96f75e-2978-4d12-a627-abd233d006b2-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:04.743150 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:04.742906    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf96f75e-2978-4d12-a627-abd233d006b2-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:05.462667 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.462633    2563 generic.go:356] "Generic (PLEG): container finished" podID="bf96f75e-2978-4d12-a627-abd233d006b2" containerID="4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9" exitCode=0
Jul 02 19:39:05.462844 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.462693    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"
Jul 02 19:39:05.462844 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.462717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" event={"ID":"bf96f75e-2978-4d12-a627-abd233d006b2","Type":"ContainerDied","Data":"4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9"}
Jul 02 19:39:05.462844 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.462768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47" event={"ID":"bf96f75e-2978-4d12-a627-abd233d006b2","Type":"ContainerDied","Data":"d2c3696950f252c4976203ca37433f91e6cc6c9972cd86f4c33975822b0dc057"}
Jul 02 19:39:05.462844 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.462789    2563 scope.go:117] "RemoveContainer" containerID="4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9"
Jul 02 19:39:05.472676 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.472502    2563 scope.go:117] "RemoveContainer" containerID="f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"
Jul 02 19:39:05.480449 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.480433    2563 scope.go:117] "RemoveContainer" containerID="4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9"
Jul 02 19:39:05.480669 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:05.480651    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9\": container with ID starting with 4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9 not found: ID does not exist" containerID="4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9"
Jul 02 19:39:05.480715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.480678    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9"} err="failed to get container status \"4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9\": rpc error: code = NotFound desc = could not find container \"4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9\": container with ID starting with 4af6555c0db91bae03df21bcc15544a0026a6a8dd878891031d3ba072d4812c9 not found: ID does not exist"
Jul 02 19:39:05.480715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.480699    2563 scope.go:117] "RemoveContainer" containerID="f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"
Jul 02 19:39:05.480883 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:05.480868    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c\": container with ID starting with f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c not found: ID does not exist" containerID="f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"
Jul 02 19:39:05.480925 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.480886    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c"} err="failed to get container status \"f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c\": rpc error: code = NotFound desc = could not find container \"f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c\": container with ID starting with f2ff8743f678d0bc20626f68e9cdfed9cce5f19151ed172d2769731aaa4cff4c not found: ID does not exist"
Jul 02 19:39:05.483838 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.483816    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"]
Jul 02 19:39:05.487748 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:05.487725    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4ae35c-openshift-default-664c5df6df-mfl47"]
Jul 02 19:39:06.495374 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:06.495339    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" path="/var/lib/kubelet/pods/bf96f75e-2978-4d12-a627-abd233d006b2/volumes"
Jul 02 19:39:08.729879 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.729836    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"]
Jul 02 19:39:08.730428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730406    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy"
Jul 02 19:39:08.730491 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730433    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy"
Jul 02 19:39:08.730491 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730466    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy"
Jul 02 19:39:08.730491 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730474    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy"
Jul 02 19:39:08.730598 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730498    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy"
Jul 02 19:39:08.730598 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730508    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy"
Jul 02 19:39:08.730716 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730609    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy"
Jul 02 19:39:08.730716 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.730622    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ed840b-aba3-4356-8196-0f45bd15b2ec" containerName="istio-proxy"
Jul 02 19:39:08.735178 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.735160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.737588 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.737566    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c61282-openshift-default-dockercfg-2rz7p\""
Jul 02 19:39:08.747355 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.747332    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"]
Jul 02 19:39:08.778354 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-data\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-socket\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-credential-socket\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-envoy\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-certs\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvf8\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-kube-api-access-bmvf8\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778575 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-token\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778669 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e7d29e-3acb-4fdb-affe-321e36a265e8-istiod-ca-cert\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.778669 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.778600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-podinfo\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.879794 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.879753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-socket\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.879794 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.879798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-credential-socket\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880028 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.879923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-envoy\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880028 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.879969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-certs\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880028 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvf8\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-kube-api-access-bmvf8\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880231 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-token\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880231 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e7d29e-3acb-4fdb-affe-321e36a265e8-istiod-ca-cert\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880231 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880123    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-socket\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880231 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-podinfo\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880231 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880189    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-credential-socket\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-data\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880371    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-certs\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880620 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880532    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-data\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.880848 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.880826    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e7d29e-3acb-4fdb-affe-321e36a265e8-istiod-ca-cert\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.882110 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.882093    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-envoy\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.882434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.882415    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-podinfo\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.888408 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.888380    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvf8\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-kube-api-access-bmvf8\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.888820 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.888803    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-token\") pod \"e2e-api-b-c61282-openshift-default-568f74c497-rqnqh\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") " pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:08.968316 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:08.968291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:39:09.045443 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.045411    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:09.181438 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.181411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"]
Jul 02 19:39:09.183145 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:39:09.183121    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e7d29e_3acb_4fdb_affe_321e36a265e8.slice/crio-8f03ae0d4995dbd43df12bcb56a31b3e1949b862883ed95bb9cf78bed68586b3 WatchSource:0}: Error finding container 8f03ae0d4995dbd43df12bcb56a31b3e1949b862883ed95bb9cf78bed68586b3: Status 404 returned error can't find the container with id 8f03ae0d4995dbd43df12bcb56a31b3e1949b862883ed95bb9cf78bed68586b3
Jul 02 19:39:09.185663 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.185629    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:09.185757 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.185696    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:09.185757 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.185724    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:09.484091 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.484006    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" event={"ID":"04e7d29e-3acb-4fdb-affe-321e36a265e8","Type":"ContainerStarted","Data":"3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"}
Jul 02 19:39:09.484091 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.484061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" event={"ID":"04e7d29e-3acb-4fdb-affe-321e36a265e8","Type":"ContainerStarted","Data":"8f03ae0d4995dbd43df12bcb56a31b3e1949b862883ed95bb9cf78bed68586b3"}
Jul 02 19:39:09.503436 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:09.503391    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" podStartSLOduration=1.5033776699999999 podStartE2EDuration="1.50337767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:09.501328016 +0000 UTC m=+2031.501464812" watchObservedRunningTime="2026-07-02 19:39:09.50337767 +0000 UTC m=+2031.503514502"
Jul 02 19:39:10.046547 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:10.046505    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:10.051957 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:10.051932    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:10.494649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:10.494572    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:10.494649 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:10.494641    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:11.703310 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.703279    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"]
Jul 02 19:39:11.703704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.703691    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf96f75e-2978-4d12-a627-abd233d006b2" containerName="istio-proxy"
Jul 02 19:39:11.707070 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.707050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.710559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.710537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:39:11.710683 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.710582    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-c61282-serving-cert\""
Jul 02 19:39:11.728812 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.728783    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"]
Jul 02 19:39:11.808610 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.808580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.808810 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.808637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c59cc228-8418-429a-a013-ce9620351a6a-openshift-service-ca\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.808810 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.808750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtvf\" (UniqueName: \"kubernetes.io/projected/c59cc228-8418-429a-a013-ce9620351a6a-kube-api-access-lbtvf\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.910066 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.910033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.910312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.910094    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c59cc228-8418-429a-a013-ce9620351a6a-openshift-service-ca\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.910312 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.910139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtvf\" (UniqueName: \"kubernetes.io/projected/c59cc228-8418-429a-a013-ce9620351a6a-kube-api-access-lbtvf\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.910312 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:11.910231    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-c61282-serving-cert: secret "maas-api-e2e-api-b-c61282-serving-cert" not found
Jul 02 19:39:11.910499 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:11.910315    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls podName:c59cc228-8418-429a-a013-ce9620351a6a nodeName:}" failed. No retries permitted until 2026-07-02 19:39:12.41029114 +0000 UTC m=+2034.410427926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls") pod "maas-api-e2e-api-b-c61282-8469979698-tf42p" (UID: "c59cc228-8418-429a-a013-ce9620351a6a") : secret "maas-api-e2e-api-b-c61282-serving-cert" not found
Jul 02 19:39:11.910751 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.910731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c59cc228-8418-429a-a013-ce9620351a6a-openshift-service-ca\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:11.925842 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:11.925793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtvf\" (UniqueName: \"kubernetes.io/projected/c59cc228-8418-429a-a013-ce9620351a6a-kube-api-access-lbtvf\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:12.414675 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:12.414640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:12.414901 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:12.414809    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-c61282-serving-cert: secret "maas-api-e2e-api-b-c61282-serving-cert" not found
Jul 02 19:39:12.414901 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:12.414885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls podName:c59cc228-8418-429a-a013-ce9620351a6a nodeName:}" failed. No retries permitted until 2026-07-02 19:39:13.414866449 +0000 UTC m=+2035.415003236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls") pod "maas-api-e2e-api-b-c61282-8469979698-tf42p" (UID: "c59cc228-8418-429a-a013-ce9620351a6a") : secret "maas-api-e2e-api-b-c61282-serving-cert" not found
Jul 02 19:39:13.424922 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:13.424879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:13.428155 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:13.428121    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") pod \"maas-api-e2e-api-b-c61282-8469979698-tf42p\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") " pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:13.517763 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:13.517732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:13.719932 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:13.719902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"]
Jul 02 19:39:13.739236 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:39:13.721547    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59cc228_8418_429a_a013_ce9620351a6a.slice/crio-85bb14980358c84a9a791fc2011cdbd4b5ce797cf48ba4fa1a05ee2fe3b4d969 WatchSource:0}: Error finding container 85bb14980358c84a9a791fc2011cdbd4b5ce797cf48ba4fa1a05ee2fe3b4d969: Status 404 returned error can't find the container with id 85bb14980358c84a9a791fc2011cdbd4b5ce797cf48ba4fa1a05ee2fe3b4d969
Jul 02 19:39:14.509696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:14.509607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p" event={"ID":"c59cc228-8418-429a-a013-ce9620351a6a","Type":"ContainerStarted","Data":"85bb14980358c84a9a791fc2011cdbd4b5ce797cf48ba4fa1a05ee2fe3b4d969"}
Jul 02 19:39:15.516751 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:15.516704    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p" event={"ID":"c59cc228-8418-429a-a013-ce9620351a6a","Type":"ContainerStarted","Data":"ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015"}
Jul 02 19:39:15.517133 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:15.516787    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:15.535790 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:15.535740    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p" podStartSLOduration=3.491962046 podStartE2EDuration="4.535722108s" totalImagesPullingTime="1.043760062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:15.532797999 +0000 UTC m=+2037.532934796" watchObservedRunningTime="2026-07-02 19:39:15.535722108 +0000 UTC m=+2037.535858904"
Jul 02 19:39:17.447638 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.447600    2563 patch_prober.go:28] interesting pod/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:39:17.448045 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.447681    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:39:17.529254 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.529221    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerID="5f3052a9948c08e56088294da4653ec6653a82d9799381e0b6c5806f958b55e5" exitCode=0
Jul 02 19:39:17.529402 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.529295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" event={"ID":"5d5c4492-0392-4efd-ba83-80c6dfd5f66f","Type":"ContainerDied","Data":"5f3052a9948c08e56088294da4653ec6653a82d9799381e0b6c5806f958b55e5"}
Jul 02 19:39:17.529709 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.529690    2563 scope.go:117] "RemoveContainer" containerID="5f3052a9948c08e56088294da4653ec6653a82d9799381e0b6c5806f958b55e5"
Jul 02 19:39:17.530698 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.530669    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:17.530769 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.530752    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:17.530812 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:17.530799    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:18.544767 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:18.544726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" event={"ID":"5d5c4492-0392-4efd-ba83-80c6dfd5f66f","Type":"ContainerStarted","Data":"d3d242abe5a22c0a0a9642a579edd54f5bc3ecc9e1672c0bbabcca3e11c0682e"}
Jul 02 19:39:18.569326 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:18.569294    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:18.569547 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:18.569524    2563 patch_prober.go:28] interesting pod/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:39:18.569632 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:18.569577    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:39:19.569582 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:19.569547    2563 patch_prober.go:28] interesting pod/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:39:19.569977 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:19.569601    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:39:20.569941 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:20.569904    2563 patch_prober.go:28] interesting pod/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:39:20.570341 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:20.569955    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:39:21.059616 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:21.059581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:39:21.534496 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:21.534463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:21.569705 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:21.569674    2563 patch_prober.go:28] interesting pod/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:39:21.569859 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:21.569724    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:39:22.570178 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:22.570135    2563 patch_prober.go:28] interesting pod/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 02 19:39:22.570691 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:22.570224    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 02 19:39:23.573832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:23.573803    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:23.574184 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:23.574166    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:23.574853 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:23.574814    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:29.604730 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:29.604698    2563 generic.go:356] "Generic (PLEG): container finished" podID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerID="3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f" exitCode=0
Jul 02 19:39:29.605155 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:29.604772    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" event={"ID":"04e7d29e-3acb-4fdb-affe-321e36a265e8","Type":"ContainerDied","Data":"3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"}
Jul 02 19:39:29.605155 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:29.605143    2563 scope.go:117] "RemoveContainer" containerID="3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"
Jul 02 19:39:29.606094 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:29.606064    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:29.606186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:29.606144    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:29.606283 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:29.606189    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:30.518963 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:30.517583    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"]
Jul 02 19:39:30.519997 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:30.519956    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy" containerID="cri-o://d3d242abe5a22c0a0a9642a579edd54f5bc3ecc9e1672c0bbabcca3e11c0682e" gracePeriod=30
Jul 02 19:39:30.612079 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:30.612047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" event={"ID":"04e7d29e-3acb-4fdb-affe-321e36a265e8","Type":"ContainerStarted","Data":"01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5"}
Jul 02 19:39:30.660718 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:30.660678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:39:31.046160 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:31.046128    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:31.046502 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:31.046316    2563 patch_prober.go:28] interesting pod/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:39:31.046623 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:31.046547    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:39:31.596985 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:31.596952    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"]
Jul 02 19:39:31.597363 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:31.597178    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p" podUID="c59cc228-8418-429a-a013-ce9620351a6a" containerName="maas-api" containerID="cri-o://ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015" gracePeriod=30
Jul 02 19:39:31.892840 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:31.892818    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:32.046563 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.046528    2563 patch_prober.go:28] interesting pod/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:39:32.046772 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.046583    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:39:32.049848 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.049824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c59cc228-8418-429a-a013-ce9620351a6a-openshift-service-ca\") pod \"c59cc228-8418-429a-a013-ce9620351a6a\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") "
Jul 02 19:39:32.049978 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.049886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") pod \"c59cc228-8418-429a-a013-ce9620351a6a\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") "
Jul 02 19:39:32.049978 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.049925    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbtvf\" (UniqueName: \"kubernetes.io/projected/c59cc228-8418-429a-a013-ce9620351a6a-kube-api-access-lbtvf\") pod \"c59cc228-8418-429a-a013-ce9620351a6a\" (UID: \"c59cc228-8418-429a-a013-ce9620351a6a\") "
Jul 02 19:39:32.050212 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.050172    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c59cc228-8418-429a-a013-ce9620351a6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c59cc228-8418-429a-a013-ce9620351a6a" (UID: "c59cc228-8418-429a-a013-ce9620351a6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:39:32.052023 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.051996    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c59cc228-8418-429a-a013-ce9620351a6a" (UID: "c59cc228-8418-429a-a013-ce9620351a6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:39:32.052023 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.052003    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c59cc228-8418-429a-a013-ce9620351a6a-kube-api-access-lbtvf" (OuterVolumeSpecName: "kube-api-access-lbtvf") pod "c59cc228-8418-429a-a013-ce9620351a6a" (UID: "c59cc228-8418-429a-a013-ce9620351a6a"). InnerVolumeSpecName "kube-api-access-lbtvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:32.157161 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.151542    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbtvf\" (UniqueName: \"kubernetes.io/projected/c59cc228-8418-429a-a013-ce9620351a6a-kube-api-access-lbtvf\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:32.157161 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.151578    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c59cc228-8418-429a-a013-ce9620351a6a-openshift-service-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:32.157161 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.151593    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c59cc228-8418-429a-a013-ce9620351a6a-maas-api-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:32.626541 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.626507    2563 generic.go:356] "Generic (PLEG): container finished" podID="c59cc228-8418-429a-a013-ce9620351a6a" containerID="ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015" exitCode=0
Jul 02 19:39:32.626910 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.626885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p" event={"ID":"c59cc228-8418-429a-a013-ce9620351a6a","Type":"ContainerDied","Data":"ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015"}
Jul 02 19:39:32.627100 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.627076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p" event={"ID":"c59cc228-8418-429a-a013-ce9620351a6a","Type":"ContainerDied","Data":"85bb14980358c84a9a791fc2011cdbd4b5ce797cf48ba4fa1a05ee2fe3b4d969"}
Jul 02 19:39:32.627276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.627259    2563 scope.go:117] "RemoveContainer" containerID="ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015"
Jul 02 19:39:32.627625 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.627593    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"
Jul 02 19:39:32.646136 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.646106    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"]
Jul 02 19:39:32.646593 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.646339    2563 scope.go:117] "RemoveContainer" containerID="ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015"
Jul 02 19:39:32.650168 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.650139    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-c61282-8469979698-tf42p"]
Jul 02 19:39:32.650426 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:32.650398    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015\": container with ID starting with ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015 not found: ID does not exist" containerID="ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015"
Jul 02 19:39:32.650516 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:32.650438    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015"} err="failed to get container status \"ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015\": rpc error: code = NotFound desc = could not find container \"ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015\": container with ID starting with ab0289219c403d66ae71adf243b4e7246e2d1ed8a791f46cd02895aad0f63015 not found: ID does not exist"
Jul 02 19:39:33.045810 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:33.045775    2563 patch_prober.go:28] interesting pod/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:39:33.046430 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:33.046386    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:39:34.046169 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:34.046119    2563 patch_prober.go:28] interesting pod/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 02 19:39:34.046682 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:34.046285    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 02 19:39:34.494674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:34.494596    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c59cc228-8418-429a-a013-ce9620351a6a" path="/var/lib/kubelet/pods/c59cc228-8418-429a-a013-ce9620351a6a/volumes"
Jul 02 19:39:35.049028 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.048998    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:35.049434 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.049289    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:35.049890 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.049871    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:35.649277 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.649249    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerID="d3d242abe5a22c0a0a9642a579edd54f5bc3ecc9e1672c0bbabcca3e11c0682e" exitCode=0
Jul 02 19:39:35.649382 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.649318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" event={"ID":"5d5c4492-0392-4efd-ba83-80c6dfd5f66f","Type":"ContainerDied","Data":"d3d242abe5a22c0a0a9642a579edd54f5bc3ecc9e1672c0bbabcca3e11c0682e"}
Jul 02 19:39:35.649427 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.649396    2563 scope.go:117] "RemoveContainer" containerID="5f3052a9948c08e56088294da4653ec6653a82d9799381e0b6c5806f958b55e5"
Jul 02 19:39:35.793959 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.793902    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:35.888173 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-socket\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888218    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-data\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888256    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-envoy\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888272    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-podinfo\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888316    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9vxd\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-kube-api-access-x9vxd\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-token\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888380 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888382    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istiod-ca-cert\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888727 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888437    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:35.888727 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-certs\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888727 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888553    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-credential-socket\") pod \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\" (UID: \"5d5c4492-0392-4efd-ba83-80c6dfd5f66f\") "
Jul 02 19:39:35.888877 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888811    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:39:35.888877 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.888849    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.889086 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.889038    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:35.889086 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.889050    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:35.889261 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.889124    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:35.891021 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.891001    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:39:35.891117 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.891020    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-kube-api-access-x9vxd" (OuterVolumeSpecName: "kube-api-access-x9vxd") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "kube-api-access-x9vxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:35.891117 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.891055    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:35.891117 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.891065    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d5c4492-0392-4efd-ba83-80c6dfd5f66f" (UID: "5d5c4492-0392-4efd-ba83-80c6dfd5f66f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:35.990121 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990086    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990121 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990115    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990121 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990126    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990138    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9vxd\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-kube-api-access-x9vxd\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990149    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990160    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990170    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:35.990376 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:35.990181    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d5c4492-0392-4efd-ba83-80c6dfd5f66f-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:36.658241 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:36.658209    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"
Jul 02 19:39:36.658732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:36.658244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq" event={"ID":"5d5c4492-0392-4efd-ba83-80c6dfd5f66f","Type":"ContainerDied","Data":"095199edc0a7ffa94d132fe567f796d41a75a12833336b9f8b337ba0fbeee47e"}
Jul 02 19:39:36.658732 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:36.658304    2563 scope.go:117] "RemoveContainer" containerID="d3d242abe5a22c0a0a9642a579edd54f5bc3ecc9e1672c0bbabcca3e11c0682e"
Jul 02 19:39:36.674468 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:36.674447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"]
Jul 02 19:39:36.678156 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:36.678134    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c8695a-openshift-default-85b7bd5975-hgdvq"]
Jul 02 19:39:37.460555 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:37.460513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"]
Jul 02 19:39:37.665554 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:37.665508    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy" containerID="cri-o://01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5" gracePeriod=30
Jul 02 19:39:38.350760 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.350729    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"]
Jul 02 19:39:38.351151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351134    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy"
Jul 02 19:39:38.351271 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351153    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy"
Jul 02 19:39:38.351271 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351187    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c59cc228-8418-429a-a013-ce9620351a6a" containerName="maas-api"
Jul 02 19:39:38.351271 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351211    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c59cc228-8418-429a-a013-ce9620351a6a" containerName="maas-api"
Jul 02 19:39:38.351428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351329    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c59cc228-8418-429a-a013-ce9620351a6a" containerName="maas-api"
Jul 02 19:39:38.351428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351344    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy"
Jul 02 19:39:38.351428 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.351356    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy"
Jul 02 19:39:38.356112 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.356092    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.358317 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.358297    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-4a101a-openshift-default-dockercfg-hvfq8\""
Jul 02 19:39:38.367438 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.367417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"]
Jul 02 19:39:38.413395 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-podinfo\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-token\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-data\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-envoy\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4v5\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-kube-api-access-kn4v5\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-credential-socket\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-socket\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413674 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a024051-2bd4-47e5-94d7-24f09c6012da-istiod-ca-cert\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.413812 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.413679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-certs\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.495832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.495798    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" path="/var/lib/kubelet/pods/5d5c4492-0392-4efd-ba83-80c6dfd5f66f/volumes"
Jul 02 19:39:38.514893 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.514866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-data\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515019 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.514902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-envoy\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515019 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.514942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4v5\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-kube-api-access-kn4v5\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515019 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.514969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-credential-socket\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515019 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-socket\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515231 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a024051-2bd4-47e5-94d7-24f09c6012da-istiod-ca-cert\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515313 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-certs\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515363 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-podinfo\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515363 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515351    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-socket\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-token\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515420    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-credential-socket\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-data\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515594 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-certs\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.515953 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.515925    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a024051-2bd4-47e5-94d7-24f09c6012da-istiod-ca-cert\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.517344 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.517324    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-envoy\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.517555 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.517538    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-podinfo\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.522412 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.522391    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4v5\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-kube-api-access-kn4v5\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.522501 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.522448    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-token\") pod \"e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") " pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.667692 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.667613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:38.807537 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.807514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"]
Jul 02 19:39:38.809356 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:39:38.809335    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a024051_2bd4_47e5_94d7_24f09c6012da.slice/crio-b8aa33422e5ea0782f863cccb28103d20eadc4a51a4ecb908678ffad2f1b8248 WatchSource:0}: Error finding container b8aa33422e5ea0782f863cccb28103d20eadc4a51a4ecb908678ffad2f1b8248: Status 404 returned error can't find the container with id b8aa33422e5ea0782f863cccb28103d20eadc4a51a4ecb908678ffad2f1b8248
Jul 02 19:39:38.811511 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.811478    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:38.811585 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.811541    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:38.811585 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:38.811569    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:39.676848 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:39.676810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" event={"ID":"3a024051-2bd4-47e5-94d7-24f09c6012da","Type":"ContainerStarted","Data":"06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"}
Jul 02 19:39:39.677247 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:39.676868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" event={"ID":"3a024051-2bd4-47e5-94d7-24f09c6012da","Type":"ContainerStarted","Data":"b8aa33422e5ea0782f863cccb28103d20eadc4a51a4ecb908678ffad2f1b8248"}
Jul 02 19:39:39.698097 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:39.698049    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" podStartSLOduration=1.698034395 podStartE2EDuration="1.698034395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:39.694885331 +0000 UTC m=+2061.695022136" watchObservedRunningTime="2026-07-02 19:39:39.698034395 +0000 UTC m=+2061.698171186"
Jul 02 19:39:40.057786 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:40.057751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:39:40.668531 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:40.668499    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:40.673560 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:40.673536    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:40.681901 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:40.681878    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:40.682573 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:40.682557    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:41.760952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.760916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"]
Jul 02 19:39:41.761438 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.761308    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy"
Jul 02 19:39:41.761438 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.761321    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5c4492-0392-4efd-ba83-80c6dfd5f66f" containerName="istio-proxy"
Jul 02 19:39:41.764707 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.764688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.767066 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.767045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-4a101a-serving-cert\""
Jul 02 19:39:41.767167 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.767095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ftzfx\""
Jul 02 19:39:41.780932 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.780905    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"]
Jul 02 19:39:41.843176 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.843144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxtzk\" (UniqueName: \"kubernetes.io/projected/461f040f-b166-4b23-ac26-5ff3d7b13dd3-kube-api-access-vxtzk\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.843369 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.843217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.843369 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.843287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/461f040f-b166-4b23-ac26-5ff3d7b13dd3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.944673 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.944635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtzk\" (UniqueName: \"kubernetes.io/projected/461f040f-b166-4b23-ac26-5ff3d7b13dd3-kube-api-access-vxtzk\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.944848 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.944699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.944848 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.944721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/461f040f-b166-4b23-ac26-5ff3d7b13dd3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.944928 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:41.944844    2563 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-4a101a-serving-cert: secret "maas-api-e2e-shared-a-4a101a-serving-cert" not found
Jul 02 19:39:41.944928 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:41.944909    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls podName:461f040f-b166-4b23-ac26-5ff3d7b13dd3 nodeName:}" failed. No retries permitted until 2026-07-02 19:39:42.444892712 +0000 UTC m=+2064.445029484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls") pod "maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" (UID: "461f040f-b166-4b23-ac26-5ff3d7b13dd3") : secret "maas-api-e2e-shared-a-4a101a-serving-cert" not found
Jul 02 19:39:41.945358 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.945342    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/461f040f-b166-4b23-ac26-5ff3d7b13dd3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:41.966696 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:41.966673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxtzk\" (UniqueName: \"kubernetes.io/projected/461f040f-b166-4b23-ac26-5ff3d7b13dd3-kube-api-access-vxtzk\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:42.449234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.449188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:42.451658 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.451626    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") " pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:42.681936 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.681904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:42.818708 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.818684    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"]
Jul 02 19:39:42.820942 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:39:42.820911    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461f040f_b166_4b23_ac26_5ff3d7b13dd3.slice/crio-8e922cf3bccc252d52aed14ca2087b3030529d363eb0e7c37bd2d7438930a92d WatchSource:0}: Error finding container 8e922cf3bccc252d52aed14ca2087b3030529d363eb0e7c37bd2d7438930a92d: Status 404 returned error can't find the container with id 8e922cf3bccc252d52aed14ca2087b3030529d363eb0e7c37bd2d7438930a92d
Jul 02 19:39:42.906084 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.906057    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:42.953627 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e7d29e-3acb-4fdb-affe-321e36a265e8-istiod-ca-cert\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953646    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-podinfo\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-certs\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953719    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-data\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-credential-socket\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953979 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953781    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-token\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953979 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-envoy\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953979 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953887    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-socket\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.953979 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953928    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmvf8\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-kube-api-access-bmvf8\") pod \"04e7d29e-3acb-4fdb-affe-321e36a265e8\" (UID: \"04e7d29e-3acb-4fdb-affe-321e36a265e8\") "
Jul 02 19:39:42.954215 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.953976    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:42.954215 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954056    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:42.954215 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954067    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e7d29e-3acb-4fdb-affe-321e36a265e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:39:42.954388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954304    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04e7d29e-3acb-4fdb-affe-321e36a265e8-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:42.954388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954323    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:42.954388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954339    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:42.954537 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954401    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:42.954591 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.954544    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:42.956587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.956557    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-kube-api-access-bmvf8" (OuterVolumeSpecName: "kube-api-access-bmvf8") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "kube-api-access-bmvf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:42.956587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.956574    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:39:42.956587 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.956585    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:39:42.956763 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:42.956592    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04e7d29e-3acb-4fdb-affe-321e36a265e8" (UID: "04e7d29e-3acb-4fdb-affe-321e36a265e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:39:43.055388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.055367    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:43.055388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.055388    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:43.055545 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.055396    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:43.055545 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.055404    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:43.055545 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.055412    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04e7d29e-3acb-4fdb-affe-321e36a265e8-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:43.055545 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.055419    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmvf8\" (UniqueName: \"kubernetes.io/projected/04e7d29e-3acb-4fdb-affe-321e36a265e8-kube-api-access-bmvf8\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:39:43.698323 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.698229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" event={"ID":"461f040f-b166-4b23-ac26-5ff3d7b13dd3","Type":"ContainerStarted","Data":"79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c"}
Jul 02 19:39:43.698323 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.698283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" event={"ID":"461f040f-b166-4b23-ac26-5ff3d7b13dd3","Type":"ContainerStarted","Data":"8e922cf3bccc252d52aed14ca2087b3030529d363eb0e7c37bd2d7438930a92d"}
Jul 02 19:39:43.698548 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.698389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:43.699832 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.699805    2563 generic.go:356] "Generic (PLEG): container finished" podID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerID="01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5" exitCode=0
Jul 02 19:39:43.699953 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.699847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"
Jul 02 19:39:43.699953 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.699891    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" event={"ID":"04e7d29e-3acb-4fdb-affe-321e36a265e8","Type":"ContainerDied","Data":"01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5"}
Jul 02 19:39:43.699953 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.699945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh" event={"ID":"04e7d29e-3acb-4fdb-affe-321e36a265e8","Type":"ContainerDied","Data":"8f03ae0d4995dbd43df12bcb56a31b3e1949b862883ed95bb9cf78bed68586b3"}
Jul 02 19:39:43.700060 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.699970    2563 scope.go:117] "RemoveContainer" containerID="01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5"
Jul 02 19:39:43.709016 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.708999    2563 scope.go:117] "RemoveContainer" containerID="3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"
Jul 02 19:39:43.717596 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.717575    2563 scope.go:117] "RemoveContainer" containerID="01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5"
Jul 02 19:39:43.717863 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:43.717842    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5\": container with ID starting with 01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5 not found: ID does not exist" containerID="01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5"
Jul 02 19:39:43.717929 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.717871    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5"} err="failed to get container status \"01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5\": rpc error: code = NotFound desc = could not find container \"01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5\": container with ID starting with 01e1e3354899b85a771530c32c1ad2ea741b07f9ab08dcc5f8fc2f2c302dc9b5 not found: ID does not exist"
Jul 02 19:39:43.717929 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.717887    2563 scope.go:117] "RemoveContainer" containerID="3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"
Jul 02 19:39:43.718059 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.718023    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" podStartSLOduration=2.239481248 podStartE2EDuration="2.718008374s" totalImagesPullingTime="478.527126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:43.714894282 +0000 UTC m=+2065.715031075" watchObservedRunningTime="2026-07-02 19:39:43.718008374 +0000 UTC m=+2065.718145170"
Jul 02 19:39:43.718158 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:39:43.718133    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f\": container with ID starting with 3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f not found: ID does not exist" containerID="3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"
Jul 02 19:39:43.718214 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.718170    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f"} err="failed to get container status \"3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f\": rpc error: code = NotFound desc = could not find container \"3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f\": container with ID starting with 3b0f5a3570e50a2c48d6bcf00d5b63433185539e791e3e11e154f84106df432f not found: ID does not exist"
Jul 02 19:39:43.729972 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.729946    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"]
Jul 02 19:39:43.733145 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:43.733126    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c61282-openshift-default-568f74c497-rqnqh"]
Jul 02 19:39:44.496245 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:44.496187    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" path="/var/lib/kubelet/pods/04e7d29e-3acb-4fdb-affe-321e36a265e8/volumes"
Jul 02 19:39:46.808758 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.808726    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"]
Jul 02 19:39:46.809162 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.809142    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy"
Jul 02 19:39:46.809162 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.809154    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy"
Jul 02 19:39:46.809330 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.809318    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy"
Jul 02 19:39:46.809372 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.809335    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy"
Jul 02 19:39:46.813897 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.813878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.816467 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.816446    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f80343-openshift-default-dockercfg-lrp95\""
Jul 02 19:39:46.851850 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.851810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"]
Jul 02 19:39:46.887448 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-podinfo\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-credential-socket\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-token\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-socket\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-data\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887608 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-envoy\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887774 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-certs\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887774 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dfcfae1-135d-433d-bcfb-f121971924ec-istiod-ca-cert\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.887774 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.887739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b5zf\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-kube-api-access-5b5zf\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.988679 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.988640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dfcfae1-135d-433d-bcfb-f121971924ec-istiod-ca-cert\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.988679 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.988676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b5zf\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-kube-api-access-5b5zf\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.988946 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.988700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-podinfo\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.988946 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.988735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-credential-socket\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989072 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.988949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-token\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989072 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-socket\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989181 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-data\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989181 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-envoy\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989311 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-certs\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989514 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989488    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-socket\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989607 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989532    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dfcfae1-135d-433d-bcfb-f121971924ec-istiod-ca-cert\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989607 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989585    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-certs\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989720 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989623    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-data\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.989781 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.989731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-credential-socket\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.991406 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.991381    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-envoy\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.991406 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.991400    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-podinfo\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:46.999923 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:46.999894    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-token\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:47.000153 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.000134    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b5zf\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-kube-api-access-5b5zf\") pod \"e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") " pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:47.132287 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.132143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:47.299939 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.299915    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"]
Jul 02 19:39:47.302313 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:39:47.302288    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfcfae1_135d_433d_bcfb_f121971924ec.slice/crio-014a991984d6b757a3397dd9a1f14217ffe5c9927a7e81194704dd07baf22839 WatchSource:0}: Error finding container 014a991984d6b757a3397dd9a1f14217ffe5c9927a7e81194704dd07baf22839: Status 404 returned error can't find the container with id 014a991984d6b757a3397dd9a1f14217ffe5c9927a7e81194704dd07baf22839
Jul 02 19:39:47.304744 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.304708    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:47.304834 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.304790    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:47.304910 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.304833    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:47.723574 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.723477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" event={"ID":"6dfcfae1-135d-433d-bcfb-f121971924ec","Type":"ContainerStarted","Data":"c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"}
Jul 02 19:39:47.723574 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.723560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" event={"ID":"6dfcfae1-135d-433d-bcfb-f121971924ec","Type":"ContainerStarted","Data":"014a991984d6b757a3397dd9a1f14217ffe5c9927a7e81194704dd07baf22839"}
Jul 02 19:39:47.749671 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:47.749622    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podStartSLOduration=1.749605469 podStartE2EDuration="1.749605469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:39:47.747591646 +0000 UTC m=+2069.747728442" watchObservedRunningTime="2026-07-02 19:39:47.749605469 +0000 UTC m=+2069.749742262"
Jul 02 19:39:48.135297 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:48.135246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:48.146293 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:48.146266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:48.731355 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:48.731317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:48.735834 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:48.735807    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:39:49.711567 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:49.711541    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:39:50.609218 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:50.609160    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:39:53.775752 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:53.775717    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerID="06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348" exitCode=0
Jul 02 19:39:53.776216 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:53.775784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" event={"ID":"3a024051-2bd4-47e5-94d7-24f09c6012da","Type":"ContainerDied","Data":"06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"}
Jul 02 19:39:53.776216 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:53.776168    2563 scope.go:117] "RemoveContainer" containerID="06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"
Jul 02 19:39:53.777134 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:53.777106    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:53.777190 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:53.777173    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:53.777273 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:53.777258    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:39:54.783088 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:54.783047    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" event={"ID":"3a024051-2bd4-47e5-94d7-24f09c6012da","Type":"ContainerStarted","Data":"8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12"}
Jul 02 19:39:55.667821 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:55.667776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:55.669222 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:55.669166    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 19:39:55.669353 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:55.669237    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 19:39:55.682222 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:55.682187    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:56.668630 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:56.668594    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 19:39:56.669046 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:56.668649    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 19:39:57.668662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:57.668624    2563 patch_prober.go:28] interesting pod/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 02 19:39:57.669066 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:57.668681    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 02 19:39:58.672530 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:58.672493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:39:58.673433 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:39:58.673414    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:40:01.153689 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:01.153651    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:40:04.773351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.773309    2563 patch_prober.go:28] interesting pod/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 02 19:40:04.775824 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.773368    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 02 19:40:04.836734 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.836704    2563 generic.go:356] "Generic (PLEG): container finished" podID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerID="c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7" exitCode=0
Jul 02 19:40:04.836866 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.836776    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" event={"ID":"6dfcfae1-135d-433d-bcfb-f121971924ec","Type":"ContainerDied","Data":"c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"}
Jul 02 19:40:04.837276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.837257    2563 scope.go:117] "RemoveContainer" containerID="c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"
Jul 02 19:40:04.838286 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.838256    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:40:04.838374 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.838338    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:40:04.838432 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:04.838384    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 02 19:40:05.847038 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:05.847000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" event={"ID":"6dfcfae1-135d-433d-bcfb-f121971924ec","Type":"ContainerStarted","Data":"5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d"}
Jul 02 19:40:06.132769 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:06.132660    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:40:06.133088 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:06.133057    2563 patch_prober.go:28] interesting pod/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 19:40:06.133186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:06.133115    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 19:40:07.133819 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:07.133783    2563 patch_prober.go:28] interesting pod/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 19:40:07.134390 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:07.134357    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 19:40:08.133589 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:08.133553    2563 patch_prober.go:28] interesting pod/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 19:40:08.133883 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:08.133856    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 19:40:09.133616 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:09.133577    2563 patch_prober.go:28] interesting pod/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 02 19:40:09.133911 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:09.133881    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 02 19:40:10.136266 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:10.136236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:40:10.136715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:10.136693    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:40:10.137389 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:10.137372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:40:15.566682 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:15.566646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:40:18.532006 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:18.531977    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:40:18.537340 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:18.537318    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:40:18.538805 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:18.538782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:40:18.543493 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:40:18.543476    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:41:08.553073 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:41:08.553038    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:41:23.966457 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:41:23.966423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:41:40.462681 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:41:40.462644    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:41:55.864498 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:41:55.864451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:42:11.554611 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:42:11.554575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:42:27.167463 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:42:27.167431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:42:40.461348 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:42:40.461263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:42:56.961660 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:42:56.961625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:43:15.263808 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:43:15.263771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:43:35.962466 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:43:35.962429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:43:54.066765 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:43:54.066729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:44:11.869628 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:44:11.869532    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:44:28.639778 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:44:28.639740    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:44:47.167927 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:44:47.167885    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:45:00.132043 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.132008    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"]
Jul 02 19:45:00.132529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.132411    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy"
Jul 02 19:45:00.132529 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.132423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e7d29e-3acb-4fdb-affe-321e36a265e8" containerName="istio-proxy"
Jul 02 19:45:00.135523 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.135496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:00.138230 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.138182    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717025-dtcfx"]
Jul 02 19:45:00.152891 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.152859    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"]
Jul 02 19:45:00.153547 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.153521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:00.157666 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.157646    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"]
Jul 02 19:45:00.157849 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.157831    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717025-dtcfx"]
Jul 02 19:45:00.157942 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.157771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:00.158685 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.158652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"]
Jul 02 19:45:00.159125 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.159100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnr9s\" (UniqueName: \"kubernetes.io/projected/6857cd89-616c-4ac9-9aee-4241c74800b3-kube-api-access-nnr9s\") pod \"maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d\" (UID: \"6857cd89-616c-4ac9-9aee-4241c74800b3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:00.260565 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.260530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqxtb\" (UniqueName: \"kubernetes.io/projected/81c073e0-1fb6-4e8f-991c-23ab7594652f-kube-api-access-mqxtb\") pod \"maas-api-key-cleanup-29717025-dtcfx\" (UID: \"81c073e0-1fb6-4e8f-991c-23ab7594652f\") " pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:00.260735 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.260638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpxs\" (UniqueName: \"kubernetes.io/projected/27555c59-bd26-4127-a99d-6d227d5d76c6-kube-api-access-ljpxs\") pod \"maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz\" (UID: \"27555c59-bd26-4127-a99d-6d227d5d76c6\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:00.260735 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.260685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnr9s\" (UniqueName: \"kubernetes.io/projected/6857cd89-616c-4ac9-9aee-4241c74800b3-kube-api-access-nnr9s\") pod \"maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d\" (UID: \"6857cd89-616c-4ac9-9aee-4241c74800b3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:00.269685 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.269659    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnr9s\" (UniqueName: \"kubernetes.io/projected/6857cd89-616c-4ac9-9aee-4241c74800b3-kube-api-access-nnr9s\") pod \"maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d\" (UID: \"6857cd89-616c-4ac9-9aee-4241c74800b3\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:00.361348 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.361304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpxs\" (UniqueName: \"kubernetes.io/projected/27555c59-bd26-4127-a99d-6d227d5d76c6-kube-api-access-ljpxs\") pod \"maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz\" (UID: \"27555c59-bd26-4127-a99d-6d227d5d76c6\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:00.361513 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.361403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqxtb\" (UniqueName: \"kubernetes.io/projected/81c073e0-1fb6-4e8f-991c-23ab7594652f-kube-api-access-mqxtb\") pod \"maas-api-key-cleanup-29717025-dtcfx\" (UID: \"81c073e0-1fb6-4e8f-991c-23ab7594652f\") " pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:00.369346 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.369319    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqxtb\" (UniqueName: \"kubernetes.io/projected/81c073e0-1fb6-4e8f-991c-23ab7594652f-kube-api-access-mqxtb\") pod \"maas-api-key-cleanup-29717025-dtcfx\" (UID: \"81c073e0-1fb6-4e8f-991c-23ab7594652f\") " pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:00.369557 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.369374    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpxs\" (UniqueName: \"kubernetes.io/projected/27555c59-bd26-4127-a99d-6d227d5d76c6-kube-api-access-ljpxs\") pod \"maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz\" (UID: \"27555c59-bd26-4127-a99d-6d227d5d76c6\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:00.451130 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.451040    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:00.468006 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.467979    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:00.474116 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.474092    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:00.610958 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.610931    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"]
Jul 02 19:45:00.616427 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:45:00.613254    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6857cd89_616c_4ac9_9aee_4241c74800b3.slice/crio-35604b3ee1b70fc5d4d4eeb21aa3159f16fe48ff525bcfd64be4b3be66514949 WatchSource:0}: Error finding container 35604b3ee1b70fc5d4d4eeb21aa3159f16fe48ff525bcfd64be4b3be66514949: Status 404 returned error can't find the container with id 35604b3ee1b70fc5d4d4eeb21aa3159f16fe48ff525bcfd64be4b3be66514949
Jul 02 19:45:00.839280 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.839252    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717025-dtcfx"]
Jul 02 19:45:00.842685 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:00.842651    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"]
Jul 02 19:45:00.842817 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:45:00.842762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c073e0_1fb6_4e8f_991c_23ab7594652f.slice/crio-21bd8c2c68ad802db981d5829dcc9b3708ad6caa3476f651e26920d56635e53e WatchSource:0}: Error finding container 21bd8c2c68ad802db981d5829dcc9b3708ad6caa3476f651e26920d56635e53e: Status 404 returned error can't find the container with id 21bd8c2c68ad802db981d5829dcc9b3708ad6caa3476f651e26920d56635e53e
Jul 02 19:45:00.846346 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:45:00.846321    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27555c59_bd26_4127_a99d_6d227d5d76c6.slice/crio-04435f378bf924780870f35c3cddaa5f71139567f570df0280d5e25c68fa45ac WatchSource:0}: Error finding container 04435f378bf924780870f35c3cddaa5f71139567f570df0280d5e25c68fa45ac: Status 404 returned error can't find the container with id 04435f378bf924780870f35c3cddaa5f71139567f570df0280d5e25c68fa45ac
Jul 02 19:45:01.352289 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.352251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz" event={"ID":"27555c59-bd26-4127-a99d-6d227d5d76c6","Type":"ContainerStarted","Data":"59e67d8b73a181c4afe46b16fef264f09178699bdf09928ca2d049d9af8e65d3"}
Jul 02 19:45:01.352723 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.352314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz" event={"ID":"27555c59-bd26-4127-a99d-6d227d5d76c6","Type":"ContainerStarted","Data":"04435f378bf924780870f35c3cddaa5f71139567f570df0280d5e25c68fa45ac"}
Jul 02 19:45:01.353834 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.353810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx" event={"ID":"81c073e0-1fb6-4e8f-991c-23ab7594652f","Type":"ContainerStarted","Data":"8d627cc46363a5a90f7afb8f97ecfb739472cfb42c211757463b6b0724f53838"}
Jul 02 19:45:01.353961 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.353859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx" event={"ID":"81c073e0-1fb6-4e8f-991c-23ab7594652f","Type":"ContainerStarted","Data":"21bd8c2c68ad802db981d5829dcc9b3708ad6caa3476f651e26920d56635e53e"}
Jul 02 19:45:01.355236 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.355188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d" event={"ID":"6857cd89-616c-4ac9-9aee-4241c74800b3","Type":"ContainerStarted","Data":"4b490480af687456acf16eab694558e1a8d50b3f6252c36ac64b4982768698f0"}
Jul 02 19:45:01.355329 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.355252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d" event={"ID":"6857cd89-616c-4ac9-9aee-4241c74800b3","Type":"ContainerStarted","Data":"35604b3ee1b70fc5d4d4eeb21aa3159f16fe48ff525bcfd64be4b3be66514949"}
Jul 02 19:45:01.370156 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.370109    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz" podStartSLOduration=1.370093394 podStartE2EDuration="1.370093394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:01.367879978 +0000 UTC m=+2383.368016763" watchObservedRunningTime="2026-07-02 19:45:01.370093394 +0000 UTC m=+2383.370230185"
Jul 02 19:45:01.385226 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.385129    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx" podStartSLOduration=1.385116478 podStartE2EDuration="1.385116478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:01.384103745 +0000 UTC m=+2383.384240541" watchObservedRunningTime="2026-07-02 19:45:01.385116478 +0000 UTC m=+2383.385253263"
Jul 02 19:45:01.401795 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:01.401757    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d" podStartSLOduration=1.40174587 podStartE2EDuration="1.40174587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:01.399643754 +0000 UTC m=+2383.399780549" watchObservedRunningTime="2026-07-02 19:45:01.40174587 +0000 UTC m=+2383.401882663"
Jul 02 19:45:02.362279 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:02.362241    2563 generic.go:356] "Generic (PLEG): container finished" podID="81c073e0-1fb6-4e8f-991c-23ab7594652f" containerID="8d627cc46363a5a90f7afb8f97ecfb739472cfb42c211757463b6b0724f53838" exitCode=0
Jul 02 19:45:02.362687 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:02.362316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx" event={"ID":"81c073e0-1fb6-4e8f-991c-23ab7594652f","Type":"ContainerDied","Data":"8d627cc46363a5a90f7afb8f97ecfb739472cfb42c211757463b6b0724f53838"}
Jul 02 19:45:02.363707 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:02.363684    2563 generic.go:356] "Generic (PLEG): container finished" podID="6857cd89-616c-4ac9-9aee-4241c74800b3" containerID="4b490480af687456acf16eab694558e1a8d50b3f6252c36ac64b4982768698f0" exitCode=0
Jul 02 19:45:02.363792 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:02.363769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d" event={"ID":"6857cd89-616c-4ac9-9aee-4241c74800b3","Type":"ContainerDied","Data":"4b490480af687456acf16eab694558e1a8d50b3f6252c36ac64b4982768698f0"}
Jul 02 19:45:02.365086 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:02.365066    2563 generic.go:356] "Generic (PLEG): container finished" podID="27555c59-bd26-4127-a99d-6d227d5d76c6" containerID="59e67d8b73a181c4afe46b16fef264f09178699bdf09928ca2d049d9af8e65d3" exitCode=0
Jul 02 19:45:02.365187 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:02.365094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz" event={"ID":"27555c59-bd26-4127-a99d-6d227d5d76c6","Type":"ContainerDied","Data":"59e67d8b73a181c4afe46b16fef264f09178699bdf09928ca2d049d9af8e65d3"}
Jul 02 19:45:03.513291 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.513101    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:03.580263 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.580238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:03.583549 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.583533    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:03.592952 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.592929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqxtb\" (UniqueName: \"kubernetes.io/projected/81c073e0-1fb6-4e8f-991c-23ab7594652f-kube-api-access-mqxtb\") pod \"81c073e0-1fb6-4e8f-991c-23ab7594652f\" (UID: \"81c073e0-1fb6-4e8f-991c-23ab7594652f\") "
Jul 02 19:45:03.594874 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.594849    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81c073e0-1fb6-4e8f-991c-23ab7594652f-kube-api-access-mqxtb" (OuterVolumeSpecName: "kube-api-access-mqxtb") pod "81c073e0-1fb6-4e8f-991c-23ab7594652f" (UID: "81c073e0-1fb6-4e8f-991c-23ab7594652f"). InnerVolumeSpecName "kube-api-access-mqxtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:45:03.694008 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.693920    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljpxs\" (UniqueName: \"kubernetes.io/projected/27555c59-bd26-4127-a99d-6d227d5d76c6-kube-api-access-ljpxs\") pod \"27555c59-bd26-4127-a99d-6d227d5d76c6\" (UID: \"27555c59-bd26-4127-a99d-6d227d5d76c6\") "
Jul 02 19:45:03.694155 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.694109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnr9s\" (UniqueName: \"kubernetes.io/projected/6857cd89-616c-4ac9-9aee-4241c74800b3-kube-api-access-nnr9s\") pod \"6857cd89-616c-4ac9-9aee-4241c74800b3\" (UID: \"6857cd89-616c-4ac9-9aee-4241c74800b3\") "
Jul 02 19:45:03.694359 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.694339    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqxtb\" (UniqueName: \"kubernetes.io/projected/81c073e0-1fb6-4e8f-991c-23ab7594652f-kube-api-access-mqxtb\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:45:03.696104 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.696067    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27555c59-bd26-4127-a99d-6d227d5d76c6-kube-api-access-ljpxs" (OuterVolumeSpecName: "kube-api-access-ljpxs") pod "27555c59-bd26-4127-a99d-6d227d5d76c6" (UID: "27555c59-bd26-4127-a99d-6d227d5d76c6"). InnerVolumeSpecName "kube-api-access-ljpxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:45:03.696104 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.696076    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6857cd89-616c-4ac9-9aee-4241c74800b3-kube-api-access-nnr9s" (OuterVolumeSpecName: "kube-api-access-nnr9s") pod "6857cd89-616c-4ac9-9aee-4241c74800b3" (UID: "6857cd89-616c-4ac9-9aee-4241c74800b3"). InnerVolumeSpecName "kube-api-access-nnr9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:45:03.794960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.794922    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljpxs\" (UniqueName: \"kubernetes.io/projected/27555c59-bd26-4127-a99d-6d227d5d76c6-kube-api-access-ljpxs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:45:03.794960 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:03.794954    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnr9s\" (UniqueName: \"kubernetes.io/projected/6857cd89-616c-4ac9-9aee-4241c74800b3-kube-api-access-nnr9s\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:45:04.378891 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.378858    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx"
Jul 02 19:45:04.379075 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.378859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717025-dtcfx" event={"ID":"81c073e0-1fb6-4e8f-991c-23ab7594652f","Type":"ContainerDied","Data":"21bd8c2c68ad802db981d5829dcc9b3708ad6caa3476f651e26920d56635e53e"}
Jul 02 19:45:04.379075 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.379016    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="21bd8c2c68ad802db981d5829dcc9b3708ad6caa3476f651e26920d56635e53e"
Jul 02 19:45:04.380133 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.380114    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"
Jul 02 19:45:04.380269 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.380148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d" event={"ID":"6857cd89-616c-4ac9-9aee-4241c74800b3","Type":"ContainerDied","Data":"35604b3ee1b70fc5d4d4eeb21aa3159f16fe48ff525bcfd64be4b3be66514949"}
Jul 02 19:45:04.380269 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.380217    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35604b3ee1b70fc5d4d4eeb21aa3159f16fe48ff525bcfd64be4b3be66514949"
Jul 02 19:45:04.381449 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.381420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz" event={"ID":"27555c59-bd26-4127-a99d-6d227d5d76c6","Type":"ContainerDied","Data":"04435f378bf924780870f35c3cddaa5f71139567f570df0280d5e25c68fa45ac"}
Jul 02 19:45:04.381546 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.381465    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04435f378bf924780870f35c3cddaa5f71139567f570df0280d5e25c68fa45ac"
Jul 02 19:45:04.381546 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:04.381433    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"
Jul 02 19:45:17.660951 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:17.660911    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:45:18.573153 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:18.573126    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:45:18.575570 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:18.575547    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:45:18.580133 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:18.580114    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:45:18.582282 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:18.582262    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qgkkd_f409d175-8465-4bba-b626-06b7a84e18c7/ovn-acl-logging/0.log"
Jul 02 19:45:30.572068 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:30.572034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:45:39.892234 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:39.892179    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"]
Jul 02 19:45:39.893028 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:39.892996    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" podUID="461f040f-b166-4b23-ac26-5ff3d7b13dd3" containerName="maas-api" containerID="cri-o://79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c" gracePeriod=30
Jul 02 19:45:39.916264 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:39.916231    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"]
Jul 02 19:45:39.918726 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:39.918698    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-4a101a-29717025-5sv7d"]
Jul 02 19:45:40.144171 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.144114    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:45:40.224151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.224074    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxtzk\" (UniqueName: \"kubernetes.io/projected/461f040f-b166-4b23-ac26-5ff3d7b13dd3-kube-api-access-vxtzk\") pod \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") "
Jul 02 19:45:40.224151 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.224115    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls\") pod \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") "
Jul 02 19:45:40.224388 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.224263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/461f040f-b166-4b23-ac26-5ff3d7b13dd3-openshift-service-ca\") pod \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\" (UID: \"461f040f-b166-4b23-ac26-5ff3d7b13dd3\") "
Jul 02 19:45:40.224645 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.224616    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/461f040f-b166-4b23-ac26-5ff3d7b13dd3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "461f040f-b166-4b23-ac26-5ff3d7b13dd3" (UID: "461f040f-b166-4b23-ac26-5ff3d7b13dd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:45:40.226186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.226156    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461f040f-b166-4b23-ac26-5ff3d7b13dd3-kube-api-access-vxtzk" (OuterVolumeSpecName: "kube-api-access-vxtzk") pod "461f040f-b166-4b23-ac26-5ff3d7b13dd3" (UID: "461f040f-b166-4b23-ac26-5ff3d7b13dd3"). InnerVolumeSpecName "kube-api-access-vxtzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:45:40.226305 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.226234    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "461f040f-b166-4b23-ac26-5ff3d7b13dd3" (UID: "461f040f-b166-4b23-ac26-5ff3d7b13dd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:45:40.325746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.325702    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/461f040f-b166-4b23-ac26-5ff3d7b13dd3-openshift-service-ca\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.325746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.325740    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxtzk\" (UniqueName: \"kubernetes.io/projected/461f040f-b166-4b23-ac26-5ff3d7b13dd3-kube-api-access-vxtzk\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.325746 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.325752    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/461f040f-b166-4b23-ac26-5ff3d7b13dd3-maas-api-tls\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:45:40.494685 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.494609    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6857cd89-616c-4ac9-9aee-4241c74800b3" path="/var/lib/kubelet/pods/6857cd89-616c-4ac9-9aee-4241c74800b3/volumes"
Jul 02 19:45:40.568493 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.568462    2563 generic.go:356] "Generic (PLEG): container finished" podID="461f040f-b166-4b23-ac26-5ff3d7b13dd3" containerID="79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c" exitCode=0
Jul 02 19:45:40.568662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.568508    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"
Jul 02 19:45:40.568662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.568547    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" event={"ID":"461f040f-b166-4b23-ac26-5ff3d7b13dd3","Type":"ContainerDied","Data":"79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c"}
Jul 02 19:45:40.568662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.568595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l" event={"ID":"461f040f-b166-4b23-ac26-5ff3d7b13dd3","Type":"ContainerDied","Data":"8e922cf3bccc252d52aed14ca2087b3030529d363eb0e7c37bd2d7438930a92d"}
Jul 02 19:45:40.568662 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.568617    2563 scope.go:117] "RemoveContainer" containerID="79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c"
Jul 02 19:45:40.577811 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.577782    2563 scope.go:117] "RemoveContainer" containerID="79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c"
Jul 02 19:45:40.578040 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:45:40.578022    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c\": container with ID starting with 79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c not found: ID does not exist" containerID="79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c"
Jul 02 19:45:40.578093 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.578046    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c"} err="failed to get container status \"79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c\": rpc error: code = NotFound desc = could not find container \"79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c\": container with ID starting with 79f83b1d0b766c8f418350b948151496cbae10a8b7c57c6998964062ec334d2c not found: ID does not exist"
Jul 02 19:45:40.588148 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.588124    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"]
Jul 02 19:45:40.592084 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:40.592065    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-4a101a-7f64fcb666-st76l"]
Jul 02 19:45:42.494919 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:42.494886    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461f040f-b166-4b23-ac26-5ff3d7b13dd3" path="/var/lib/kubelet/pods/461f040f-b166-4b23-ac26-5ff3d7b13dd3/volumes"
Jul 02 19:45:43.661347 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:45:43.661308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:46:21.768955 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:21.768919    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"]
Jul 02 19:46:21.769481 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:21.769277    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy" containerID="cri-o://8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12" gracePeriod=30
Jul 02 19:46:22.862999 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:22.862965    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"]
Jul 02 19:46:22.866132 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:22.866105    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-f80343-29717025-hcdpz"]
Jul 02 19:46:24.495362 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:24.495326    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27555c59-bd26-4127-a99d-6d227d5d76c6" path="/var/lib/kubelet/pods/27555c59-bd26-4127-a99d-6d227d5d76c6/volumes"
Jul 02 19:46:25.972445 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:25.972414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pshv8"]
Jul 02 19:46:27.022188 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.022158    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:46:27.148715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-socket\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.148715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148684    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-credential-socket\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.148715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-podinfo\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.148958 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-data\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.148958 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148795    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-token\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.149049 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148947    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:27.149049 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.148950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn4v5\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-kube-api-access-kn4v5\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.149049 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-certs\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.149224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149072    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-envoy\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.149224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149082    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:27.149224 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149128    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a024051-2bd4-47e5-94d7-24f09c6012da-istiod-ca-cert\") pod \"3a024051-2bd4-47e5-94d7-24f09c6012da\" (UID: \"3a024051-2bd4-47e5-94d7-24f09c6012da\") "
Jul 02 19:46:27.149396 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149370    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:27.149527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149509    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.149594 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149532    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.149594 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149581    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.149722 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149700    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a024051-2bd4-47e5-94d7-24f09c6012da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:46:27.149845 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.149820    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:27.151178 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.151149    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:27.151178 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.151165    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-kube-api-access-kn4v5" (OuterVolumeSpecName: "kube-api-access-kn4v5") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "kube-api-access-kn4v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:46:27.151437 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.151415    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:46:27.151437 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.151423    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a024051-2bd4-47e5-94d7-24f09c6012da" (UID: "3a024051-2bd4-47e5-94d7-24f09c6012da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:46:27.250382 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.250342    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.250382 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.250373    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.250382 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.250385    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.250619 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.250396    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn4v5\" (UniqueName: \"kubernetes.io/projected/3a024051-2bd4-47e5-94d7-24f09c6012da-kube-api-access-kn4v5\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.250619 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.250409    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a024051-2bd4-47e5-94d7-24f09c6012da-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.250619 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.250421    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a024051-2bd4-47e5-94d7-24f09c6012da-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:27.822559 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.822526    2563 generic.go:356] "Generic (PLEG): container finished" podID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerID="8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12" exitCode=0
Jul 02 19:46:27.822762 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.822575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" event={"ID":"3a024051-2bd4-47e5-94d7-24f09c6012da","Type":"ContainerDied","Data":"8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12"}
Jul 02 19:46:27.822762 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.822578    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"
Jul 02 19:46:27.822762 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.822616    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5" event={"ID":"3a024051-2bd4-47e5-94d7-24f09c6012da","Type":"ContainerDied","Data":"b8aa33422e5ea0782f863cccb28103d20eadc4a51a4ecb908678ffad2f1b8248"}
Jul 02 19:46:27.822762 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.822638    2563 scope.go:117] "RemoveContainer" containerID="8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12"
Jul 02 19:46:27.832040 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.832023    2563 scope.go:117] "RemoveContainer" containerID="06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"
Jul 02 19:46:27.840273 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.840252    2563 scope.go:117] "RemoveContainer" containerID="8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12"
Jul 02 19:46:27.840558 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:46:27.840539    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12\": container with ID starting with 8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12 not found: ID does not exist" containerID="8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12"
Jul 02 19:46:27.840636 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.840567    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12"} err="failed to get container status \"8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12\": rpc error: code = NotFound desc = could not find container \"8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12\": container with ID starting with 8e85478a5554fc4a113eaa461e68698ddd2e20eee64123af59b6433ef7a1ba12 not found: ID does not exist"
Jul 02 19:46:27.840636 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.840584    2563 scope.go:117] "RemoveContainer" containerID="06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"
Jul 02 19:46:27.840820 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:46:27.840806    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348\": container with ID starting with 06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348 not found: ID does not exist" containerID="06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"
Jul 02 19:46:27.840869 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.840823    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348"} err="failed to get container status \"06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348\": rpc error: code = NotFound desc = could not find container \"06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348\": container with ID starting with 06e5caaad18244570d5bcb23108c53057f97dc35fe08ace7a19cfe3ccb1aa348 not found: ID does not exist"
Jul 02 19:46:27.845527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.845503    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"]
Jul 02 19:46:27.849326 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:27.849305    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-4a101a-openshift-default-859689c795-q4mj5"]
Jul 02 19:46:28.495867 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:28.495832    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" path="/var/lib/kubelet/pods/3a024051-2bd4-47e5-94d7-24f09c6012da/volumes"
Jul 02 19:46:28.901222 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:28.901174    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"]
Jul 02 19:46:28.901492 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:28.901465    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy" containerID="cri-o://5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d" gracePeriod=30
Jul 02 19:46:34.158008 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.157984    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:46:34.216904 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.216816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b5zf\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-kube-api-access-5b5zf\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.216904 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.216856    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-socket\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.216904 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.216875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-certs\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.216916    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-credential-socket\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.216943    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dfcfae1-135d-433d-bcfb-f121971924ec-istiod-ca-cert\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.216980    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-token\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-data\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217053    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-envoy\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217105    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-podinfo\") pod \"6dfcfae1-135d-433d-bcfb-f121971924ec\" (UID: \"6dfcfae1-135d-433d-bcfb-f121971924ec\") "
Jul 02 19:46:34.217250 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217118    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:34.217618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217327    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:34.217618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217344    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:34.217618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217513    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dfcfae1-135d-433d-bcfb-f121971924ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:46:34.217618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217522    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.217618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217540    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-workload-certs\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.217618 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.217554    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-credential-socket\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.218140 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.218111    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:34.219311 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.219280    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 02 19:46:34.219311 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.219300    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:46:34.219487 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.219397    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-kube-api-access-5b5zf" (OuterVolumeSpecName: "kube-api-access-5b5zf") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "kube-api-access-5b5zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:46:34.219487 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.219424    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dfcfae1-135d-433d-bcfb-f121971924ec" (UID: "6dfcfae1-135d-433d-bcfb-f121971924ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:46:34.318591 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.318558    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-podinfo\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.318591 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.318586    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b5zf\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-kube-api-access-5b5zf\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.318591 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.318597    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dfcfae1-135d-433d-bcfb-f121971924ec-istiod-ca-cert\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.318882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.318606    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-token\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.318882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.318614    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-data\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.318882 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.318621    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dfcfae1-135d-433d-bcfb-f121971924ec-istio-envoy\") on node \"ip-10-0-130-68.ec2.internal\" DevicePath \"\""
Jul 02 19:46:34.548448 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.548425    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717010-s2ljs_78c5486e-e17d-464e-9b97-51320b652df5/cleanup/0.log"
Jul 02 19:46:34.656994 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.656962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717025-dtcfx_81c073e0-1fb6-4e8f-991c-23ab7594652f/cleanup/0.log"
Jul 02 19:46:34.862065 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.862029    2563 generic.go:356] "Generic (PLEG): container finished" podID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerID="5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d" exitCode=0
Jul 02 19:46:34.862257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.862073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" event={"ID":"6dfcfae1-135d-433d-bcfb-f121971924ec","Type":"ContainerDied","Data":"5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d"}
Jul 02 19:46:34.862257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.862116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt" event={"ID":"6dfcfae1-135d-433d-bcfb-f121971924ec","Type":"ContainerDied","Data":"014a991984d6b757a3397dd9a1f14217ffe5c9927a7e81194704dd07baf22839"}
Jul 02 19:46:34.862257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.862137    2563 scope.go:117] "RemoveContainer" containerID="5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d"
Jul 02 19:46:34.862257 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.862076    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"
Jul 02 19:46:34.871473 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.871453    2563 scope.go:117] "RemoveContainer" containerID="c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"
Jul 02 19:46:34.878647 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.878621    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"]
Jul 02 19:46:34.879796 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.879777    2563 scope.go:117] "RemoveContainer" containerID="5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d"
Jul 02 19:46:34.880075 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:46:34.880052    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d\": container with ID starting with 5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d not found: ID does not exist" containerID="5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d"
Jul 02 19:46:34.880171 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.880083    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d"} err="failed to get container status \"5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d\": rpc error: code = NotFound desc = could not find container \"5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d\": container with ID starting with 5879bd84ff5527939684b48e9e978b05246312277b3dccad456075e62362e97d not found: ID does not exist"
Jul 02 19:46:34.880171 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.880102    2563 scope.go:117] "RemoveContainer" containerID="c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"
Jul 02 19:46:34.880527 ip-10-0-130-68 kubenswrapper[2563]: E0702 19:46:34.880438    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7\": container with ID starting with c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7 not found: ID does not exist" containerID="c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"
Jul 02 19:46:34.880527 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.880471    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7"} err="failed to get container status \"c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7\": rpc error: code = NotFound desc = could not find container \"c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7\": container with ID starting with c4202e9d765afbe99f9404036d8672dc0a97f37d7bbff413aea3f09f2dafd6c7 not found: ID does not exist"
Jul 02 19:46:34.883367 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:34.883345    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f80343-openshift-default-6f9b47d4ff-29tkt"]
Jul 02 19:46:35.122666 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:35.122589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cf784d988-8h7df_936b1119-b522-48db-939a-ae3c9faefdbf/copy-manifests/0.log"
Jul 02 19:46:35.129629 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:35.129606    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cf784d988-8h7df_936b1119-b522-48db-939a-ae3c9faefdbf/manager/0.log"
Jul 02 19:46:36.390670 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.390643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh_aaf40b87-5bfe-4348-8908-29e579b0b0e3/util/0.log"
Jul 02 19:46:36.397464 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.397438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh_aaf40b87-5bfe-4348-8908-29e579b0b0e3/pull/0.log"
Jul 02 19:46:36.404568 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.404550    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh_aaf40b87-5bfe-4348-8908-29e579b0b0e3/extract/0.log"
Jul 02 19:46:36.495642 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.495612    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" path="/var/lib/kubelet/pods/6dfcfae1-135d-433d-bcfb-f121971924ec/volumes"
Jul 02 19:46:36.514212 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.514170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4_64158035-4456-4a68-a411-afabda9c717c/util/0.log"
Jul 02 19:46:36.520501 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.520483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4_64158035-4456-4a68-a411-afabda9c717c/pull/0.log"
Jul 02 19:46:36.526967 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.526952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4_64158035-4456-4a68-a411-afabda9c717c/extract/0.log"
Jul 02 19:46:36.638627 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.638598    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv_3adc51d2-0726-4272-9526-bee8ce4eba92/util/0.log"
Jul 02 19:46:36.645436 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.645380    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv_3adc51d2-0726-4272-9526-bee8ce4eba92/pull/0.log"
Jul 02 19:46:36.651604 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:36.651586    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv_3adc51d2-0726-4272-9526-bee8ce4eba92/extract/0.log"
Jul 02 19:46:37.469226 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:37.469185    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pshv8_7fe8c884-1a4c-4a81-b020-4c9a4274197f/limitador/0.log"
Jul 02 19:46:38.058466 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:38.058436    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mptwx_f103ca9f-e594-46f5-8c88-d6b50f6fcf69/discovery/0.log"
Jul 02 19:46:38.517480 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:38.517448    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qvsw5_1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a/payload-pre-processing/0.log"
Jul 02 19:46:38.758217 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:38.758157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd975f88c-dch65_329fe1ed-f48d-4fb4-a2d2-0c5205236e8a/router/0.log"
Jul 02 19:46:43.346704 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.346668    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qqkdz/must-gather-b6jtp"]
Jul 02 19:46:43.347076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347009    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461f040f-b166-4b23-ac26-5ff3d7b13dd3" containerName="maas-api"
Jul 02 19:46:43.347076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347020    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="461f040f-b166-4b23-ac26-5ff3d7b13dd3" containerName="maas-api"
Jul 02 19:46:43.347076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347032    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy"
Jul 02 19:46:43.347076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347037    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy"
Jul 02 19:46:43.347076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347048    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347083    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347090    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347095    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347103    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81c073e0-1fb6-4e8f-991c-23ab7594652f" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347108    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="81c073e0-1fb6-4e8f-991c-23ab7594652f" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347118    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347123    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347134    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6857cd89-616c-4ac9-9aee-4241c74800b3" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347139    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6857cd89-616c-4ac9-9aee-4241c74800b3" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347145    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27555c59-bd26-4127-a99d-6d227d5d76c6" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347151    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27555c59-bd26-4127-a99d-6d227d5d76c6" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347240    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347253    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347265    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="461f040f-b166-4b23-ac26-5ff3d7b13dd3" containerName="maas-api"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347291    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6857cd89-616c-4ac9-9aee-4241c74800b3" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347302    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dfcfae1-135d-433d-bcfb-f121971924ec" containerName="istio-proxy"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347312    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="27555c59-bd26-4127-a99d-6d227d5d76c6" containerName="cleanup"
Jul 02 19:46:43.347351 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347322    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="81c073e0-1fb6-4e8f-991c-23ab7594652f" containerName="cleanup"
Jul 02 19:46:43.348164 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.347516    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a024051-2bd4-47e5-94d7-24f09c6012da" containerName="istio-proxy"
Jul 02 19:46:43.351857 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.351839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.354226 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.354181    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qqkdz\"/\"openshift-service-ca.crt\""
Jul 02 19:46:43.354972 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.354948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qqkdz\"/\"default-dockercfg-865ch\""
Jul 02 19:46:43.354972 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.354961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qqkdz\"/\"kube-root-ca.crt\""
Jul 02 19:46:43.358795 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.358774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqkdz/must-gather-b6jtp"]
Jul 02 19:46:43.397076 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.397047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8qbq\" (UniqueName: \"kubernetes.io/projected/4bed0826-bc24-4dcf-afa6-acd59a6ca47b-kube-api-access-b8qbq\") pod \"must-gather-b6jtp\" (UID: \"4bed0826-bc24-4dcf-afa6-acd59a6ca47b\") " pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.397276 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.397087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4bed0826-bc24-4dcf-afa6-acd59a6ca47b-must-gather-output\") pod \"must-gather-b6jtp\" (UID: \"4bed0826-bc24-4dcf-afa6-acd59a6ca47b\") " pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.497856 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.497816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8qbq\" (UniqueName: \"kubernetes.io/projected/4bed0826-bc24-4dcf-afa6-acd59a6ca47b-kube-api-access-b8qbq\") pod \"must-gather-b6jtp\" (UID: \"4bed0826-bc24-4dcf-afa6-acd59a6ca47b\") " pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.498010 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.497870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4bed0826-bc24-4dcf-afa6-acd59a6ca47b-must-gather-output\") pod \"must-gather-b6jtp\" (UID: \"4bed0826-bc24-4dcf-afa6-acd59a6ca47b\") " pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.498253 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.498236    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4bed0826-bc24-4dcf-afa6-acd59a6ca47b-must-gather-output\") pod \"must-gather-b6jtp\" (UID: \"4bed0826-bc24-4dcf-afa6-acd59a6ca47b\") " pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.505567 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.505550    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8qbq\" (UniqueName: \"kubernetes.io/projected/4bed0826-bc24-4dcf-afa6-acd59a6ca47b-kube-api-access-b8qbq\") pod \"must-gather-b6jtp\" (UID: \"4bed0826-bc24-4dcf-afa6-acd59a6ca47b\") " pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.662692 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.662614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqkdz/must-gather-b6jtp"
Jul 02 19:46:43.796264 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.796236    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqkdz/must-gather-b6jtp"]
Jul 02 19:46:43.797806 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:46:43.797767    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bed0826_bc24_4dcf_afa6_acd59a6ca47b.slice/crio-684b51520c993bd096dc5b9471aaf14b81668806b97a73acfcb6ea4e5274e57f WatchSource:0}: Error finding container 684b51520c993bd096dc5b9471aaf14b81668806b97a73acfcb6ea4e5274e57f: Status 404 returned error can't find the container with id 684b51520c993bd096dc5b9471aaf14b81668806b97a73acfcb6ea4e5274e57f
Jul 02 19:46:43.800498 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.800480    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:46:43.909517 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:43.909474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqkdz/must-gather-b6jtp" event={"ID":"4bed0826-bc24-4dcf-afa6-acd59a6ca47b","Type":"ContainerStarted","Data":"684b51520c993bd096dc5b9471aaf14b81668806b97a73acfcb6ea4e5274e57f"}
Jul 02 19:46:44.918606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:44.918516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqkdz/must-gather-b6jtp" event={"ID":"4bed0826-bc24-4dcf-afa6-acd59a6ca47b","Type":"ContainerStarted","Data":"f22f200d1c3871451f9c9e52169bbfdb4dc631b123ef1514a000c7c243d5af41"}
Jul 02 19:46:44.918606 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:44.918567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqkdz/must-gather-b6jtp" event={"ID":"4bed0826-bc24-4dcf-afa6-acd59a6ca47b","Type":"ContainerStarted","Data":"3971c743e7c00e282f92f1ba8f5a643239014bee20ececb06df07d6fd3ee3974"}
Jul 02 19:46:44.935124 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:44.935071    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qqkdz/must-gather-b6jtp" podStartSLOduration=1.114776928 podStartE2EDuration="1.935056434s" totalImagesPullingTime="820.279506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:46:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:46:44.933993598 +0000 UTC m=+2486.934130393" watchObservedRunningTime="2026-07-02 19:46:44.935056434 +0000 UTC m=+2486.935193227"
Jul 02 19:46:46.213233 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:46.213186    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mz5fw_14c46bc5-e149-424d-980b-b42c710f91de/global-pull-secret-syncer/0.log"
Jul 02 19:46:46.386123 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:46.386091    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tl8l9_181211ff-ca60-4154-8d2b-561d770c9e97/konnectivity-agent/0.log"
Jul 02 19:46:46.408864 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:46.408816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-68.ec2.internal_0dea7adbf423fab172398bcf6fc984fe/haproxy/0.log"
Jul 02 19:46:51.112354 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.112322    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh_aaf40b87-5bfe-4348-8908-29e579b0b0e3/extract/0.log"
Jul 02 19:46:51.135703 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.135659    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh_aaf40b87-5bfe-4348-8908-29e579b0b0e3/util/0.log"
Jul 02 19:46:51.162096 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.162063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qf4jh_aaf40b87-5bfe-4348-8908-29e579b0b0e3/pull/0.log"
Jul 02 19:46:51.199005 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.198969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4_64158035-4456-4a68-a411-afabda9c717c/extract/0.log"
Jul 02 19:46:51.236140 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.236060    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4_64158035-4456-4a68-a411-afabda9c717c/util/0.log"
Jul 02 19:46:51.258498 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.258465    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zldx4_64158035-4456-4a68-a411-afabda9c717c/pull/0.log"
Jul 02 19:46:51.289489 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.289430    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv_3adc51d2-0726-4272-9526-bee8ce4eba92/extract/0.log"
Jul 02 19:46:51.313470 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.313443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv_3adc51d2-0726-4272-9526-bee8ce4eba92/util/0.log"
Jul 02 19:46:51.339994 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.339969    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wwnsv_3adc51d2-0726-4272-9526-bee8ce4eba92/pull/0.log"
Jul 02 19:46:51.918031 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:51.918005    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pshv8_7fe8c884-1a4c-4a81-b020-4c9a4274197f/limitador/0.log"
Jul 02 19:46:53.886855 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:53.886825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-nrd2c_ef6b4cd2-464e-49f8-9aa9-3450d64e0762/cluster-monitoring-operator/0.log"
Jul 02 19:46:53.933173 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:53.933145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k9lpf_e5ae6b5d-49bc-4823-8284-5d253e0be2c4/kube-state-metrics/0.log"
Jul 02 19:46:53.955966 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:53.955936    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k9lpf_e5ae6b5d-49bc-4823-8284-5d253e0be2c4/kube-rbac-proxy-main/0.log"
Jul 02 19:46:53.984709 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:53.984673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-k9lpf_e5ae6b5d-49bc-4823-8284-5d253e0be2c4/kube-rbac-proxy-self/0.log"
Jul 02 19:46:54.076742 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.076715    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ccm7_66391b02-53a4-4693-94d1-dce9e9cb08d0/node-exporter/0.log"
Jul 02 19:46:54.099297 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.099274    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ccm7_66391b02-53a4-4693-94d1-dce9e9cb08d0/kube-rbac-proxy/0.log"
Jul 02 19:46:54.126378 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.126330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8ccm7_66391b02-53a4-4693-94d1-dce9e9cb08d0/init-textfile/0.log"
Jul 02 19:46:54.327505 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.327478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dm7l2_b9d15339-0974-4965-8663-684dadaa99db/kube-rbac-proxy-main/0.log"
Jul 02 19:46:54.349244 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.349213    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dm7l2_b9d15339-0974-4965-8663-684dadaa99db/kube-rbac-proxy-self/0.log"
Jul 02 19:46:54.372182 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.372147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dm7l2_b9d15339-0974-4965-8663-684dadaa99db/openshift-state-metrics/0.log"
Jul 02 19:46:54.641218 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.641130    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-dpbbf_77aeca4f-0beb-4de0-9550-615a49c05e67/prometheus-operator-admission-webhook/0.log"
Jul 02 19:46:54.761159 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.761128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb898c6b6-twhjx_f8f4a51c-fb26-4804-b592-12b732b98a0c/thanos-query/0.log"
Jul 02 19:46:54.784347 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.784317    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb898c6b6-twhjx_f8f4a51c-fb26-4804-b592-12b732b98a0c/kube-rbac-proxy-web/0.log"
Jul 02 19:46:54.805679 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.805643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb898c6b6-twhjx_f8f4a51c-fb26-4804-b592-12b732b98a0c/kube-rbac-proxy/0.log"
Jul 02 19:46:54.829226 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.829183    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb898c6b6-twhjx_f8f4a51c-fb26-4804-b592-12b732b98a0c/prom-label-proxy/0.log"
Jul 02 19:46:54.851591 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.851565    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb898c6b6-twhjx_f8f4a51c-fb26-4804-b592-12b732b98a0c/kube-rbac-proxy-rules/0.log"
Jul 02 19:46:54.875177 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:54.875146    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb898c6b6-twhjx_f8f4a51c-fb26-4804-b592-12b732b98a0c/kube-rbac-proxy-metrics/0.log"
Jul 02 19:46:55.989086 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:55.989058    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-nq8pf_6ff4e99e-b459-44db-898e-bdd58f23e263/networking-console-plugin/0.log"
Jul 02 19:46:56.614281 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.614254    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/1.log"
Jul 02 19:46:56.619520 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.619492    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-29rmk_541000a1-2cf4-413b-a73c-d55b557852d1/console-operator/2.log"
Jul 02 19:46:56.624147 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.624119    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"]
Jul 02 19:46:56.632251 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.632223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.637141 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.637111    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"]
Jul 02 19:46:56.732850 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.732776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-proc\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.733065 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.732908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-sys\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.733065 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.732971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-lib-modules\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.733065 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.733003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwz4g\" (UniqueName: \"kubernetes.io/projected/5bfe30b7-dae1-41a3-9110-ce68833e35ef-kube-api-access-bwz4g\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.733065 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.733031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-podres\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833556 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-lib-modules\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833556 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwz4g\" (UniqueName: \"kubernetes.io/projected/5bfe30b7-dae1-41a3-9110-ce68833e35ef-kube-api-access-bwz4g\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-podres\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-proc\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-sys\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833729    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-sys\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833727    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-lib-modules\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-proc\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.833803 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.833778    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5bfe30b7-dae1-41a3-9110-ce68833e35ef-podres\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.841205 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.841165    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwz4g\" (UniqueName: \"kubernetes.io/projected/5bfe30b7-dae1-41a3-9110-ce68833e35ef-kube-api-access-bwz4g\") pod \"perf-node-gather-daemonset-htzf9\" (UID: \"5bfe30b7-dae1-41a3-9110-ce68833e35ef\") " pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:56.949412 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:56.949326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:57.126548 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:57.126460    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"]
Jul 02 19:46:57.130032 ip-10-0-130-68 kubenswrapper[2563]: W0702 19:46:57.130004    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5bfe30b7_dae1_41a3_9110_ce68833e35ef.slice/crio-ed09eaf63028c1e7b41e32d3aaecde42339ca23403ed2daaf0efe5f579f0b3e3 WatchSource:0}: Error finding container ed09eaf63028c1e7b41e32d3aaecde42339ca23403ed2daaf0efe5f579f0b3e3: Status 404 returned error can't find the container with id ed09eaf63028c1e7b41e32d3aaecde42339ca23403ed2daaf0efe5f579f0b3e3
Jul 02 19:46:57.191433 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:57.191406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-jwkvq_26c2c3e6-f544-489f-912e-982dbafffff5/download-server/0.log"
Jul 02 19:46:57.742296 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:57.742254    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-cvxdf_540972c4-6ade-4a03-aef0-6b7370716ce6/volume-data-source-validator/0.log"
Jul 02 19:46:58.023215 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.023164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9" event={"ID":"5bfe30b7-dae1-41a3-9110-ce68833e35ef","Type":"ContainerStarted","Data":"fb27e0d31adfb584546bf114ba46fc35e6bedf54cd9f82218e2f3aaec036542a"}
Jul 02 19:46:58.023429 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.023257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:46:58.023429 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.023300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9" event={"ID":"5bfe30b7-dae1-41a3-9110-ce68833e35ef","Type":"ContainerStarted","Data":"ed09eaf63028c1e7b41e32d3aaecde42339ca23403ed2daaf0efe5f579f0b3e3"}
Jul 02 19:46:58.039342 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.039295    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9" podStartSLOduration=2.039281252 podStartE2EDuration="2.039281252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:46:58.037061201 +0000 UTC m=+2500.037197990" watchObservedRunningTime="2026-07-02 19:46:58.039281252 +0000 UTC m=+2500.039418045"
Jul 02 19:46:58.771651 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.771620    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5p2g6_7a29c843-42c5-467e-8901-09eaea74437f/dns/0.log"
Jul 02 19:46:58.792534 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.792506    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5p2g6_7a29c843-42c5-467e-8901-09eaea74437f/kube-rbac-proxy/0.log"
Jul 02 19:46:58.916476 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:58.916440    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-77ddp_25c836c0-6750-4015-a46d-f9da2e851165/dns-node-resolver/0.log"
Jul 02 19:46:59.546946 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:46:59.546921    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-24vp7_56a93b7a-7b85-4591-92d4-37fcfb0c8cd4/node-ca/0.log"
Jul 02 19:47:00.662935 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:00.662902    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mptwx_f103ca9f-e594-46f5-8c88-d6b50f6fcf69/discovery/0.log"
Jul 02 19:47:00.832321 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:00.832287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qvsw5_1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a/payload-pre-processing/0.log"
Jul 02 19:47:00.936597 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:00.936519    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd975f88c-dch65_329fe1ed-f48d-4fb4-a2d2-0c5205236e8a/router/0.log"
Jul 02 19:47:01.642420 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:01.642391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6dhcq_32e8db40-57d9-422f-9921-efd69a90c2a6/serve-healthcheck-canary/0.log"
Jul 02 19:47:02.172218 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:02.172150    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-r4bzw_2ce04143-9907-44b1-bffa-8f9ca68d7cce/insights-operator/0.log"
Jul 02 19:47:02.172767 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:02.172631    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-r4bzw_2ce04143-9907-44b1-bffa-8f9ca68d7cce/insights-operator/1.log"
Jul 02 19:47:02.344798 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:02.344752    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntfzt_7d5be52e-e631-404e-8854-0810c7edf2f2/kube-rbac-proxy/0.log"
Jul 02 19:47:02.371323 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:02.371295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntfzt_7d5be52e-e631-404e-8854-0810c7edf2f2/exporter/0.log"
Jul 02 19:47:02.393736 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:02.393703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ntfzt_7d5be52e-e631-404e-8854-0810c7edf2f2/extractor/0.log"
Jul 02 19:47:04.041394 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:04.041369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qqkdz/perf-node-gather-daemonset-htzf9"
Jul 02 19:47:04.793082 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:04.793056    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717010-s2ljs_78c5486e-e17d-464e-9b97-51320b652df5/cleanup/0.log"
Jul 02 19:47:04.821933 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:04.821908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717025-dtcfx_81c073e0-1fb6-4e8f-991c-23ab7594652f/cleanup/0.log"
Jul 02 19:47:05.134301 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:05.134189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cf784d988-8h7df_936b1119-b522-48db-939a-ae3c9faefdbf/manager/0.log"
Jul 02 19:47:05.157461 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:05.157432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cf784d988-8h7df_936b1119-b522-48db-939a-ae3c9faefdbf/copy-manifests/0.log"
Jul 02 19:47:06.847012 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:06.846982    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5556b8b6b-fwgkh_64e9bc2f-705f-4dcf-b1e2-72b6f6a5cfb8/manager/0.log"
Jul 02 19:47:06.888993 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:06.888966    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mptwx_f103ca9f-e594-46f5-8c88-d6b50f6fcf69/discovery/0.log"
Jul 02 19:47:07.012294 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:07.012269    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qvsw5_1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a/payload-pre-processing/0.log"
Jul 02 19:47:07.088342 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:07.088312    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd975f88c-dch65_329fe1ed-f48d-4fb4-a2d2-0c5205236e8a/router/0.log"
Jul 02 19:47:08.439186 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:08.439099    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mptwx_f103ca9f-e594-46f5-8c88-d6b50f6fcf69/discovery/0.log"
Jul 02 19:47:08.565757 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:08.565729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qvsw5_1e27b5e0-0237-4b2d-b84c-1fed9c4ebf3a/payload-pre-processing/0.log"
Jul 02 19:47:08.645715 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:08.645683    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd975f88c-dch65_329fe1ed-f48d-4fb4-a2d2-0c5205236e8a/router/0.log"
Jul 02 19:47:12.234958 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:12.234882    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rn49x_a3d70706-f8d8-4cd0-8482-4014f647862d/kube-storage-version-migrator-operator/1.log"
Jul 02 19:47:12.235944 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:12.235922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rn49x_a3d70706-f8d8-4cd0-8482-4014f647862d/kube-storage-version-migrator-operator/0.log"
Jul 02 19:47:13.548756 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.548734    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/kube-multus-additional-cni-plugins/0.log"
Jul 02 19:47:13.571852 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.571828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/egress-router-binary-copy/0.log"
Jul 02 19:47:13.596645 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.596608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/cni-plugins/0.log"
Jul 02 19:47:13.621435 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.621409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/bond-cni-plugin/0.log"
Jul 02 19:47:13.643041 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.642978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/routeoverride-cni/0.log"
Jul 02 19:47:13.665177 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.665147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/whereabouts-cni-bincopy/0.log"
Jul 02 19:47:13.686854 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.686829    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lv8kl_083bc306-b06d-41ff-b88a-060fb75d780c/whereabouts-cni/0.log"
Jul 02 19:47:13.726502 ip-10-0-130-68 kubenswrapper[2563]: I0702 19:47:13.726475    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qwc76_92d6e659-ebad-427c-b889-09a2d07b992f/kube-multus/0.log"