Jul 10 20:32:36.603345 ip-10-0-139-118 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 20:32:36.603362 ip-10-0-139-118 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 20:32:36.603371 ip-10-0-139-118 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 20:32:36.603682 ip-10-0-139-118 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 20:32:46.377070 ip-10-0-139-118 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 10 20:32:46.377086 ip-10-0-139-118 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e396c84933ff46608d06fb658bc75057 --
Jul 10 20:34:32.573649 ip-10-0-139-118 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:32.996993    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000631    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000644    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000648    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000651    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000654    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000657    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000662    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 20:34:33.062142 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000667    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000670    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000673    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000676    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000678    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000686    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000690    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000693    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000695    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000698    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000700    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000703    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000706    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000709    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000712    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000715    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000718    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000720    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000723    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000726    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 20:34:33.063154 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000729    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000733    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000736    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000739    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000742    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000745    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000747    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000751    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000754    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000756    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000759    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000762    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000764    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000766    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000769    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000772    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000774    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000776    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000779    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 20:34:33.063778 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000782    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000785    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000787    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000789    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000792    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000795    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000797    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000800    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000802    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000805    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000807    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000810    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000819    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000822    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000825    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000827    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000830    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000833    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000835    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000838    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 20:34:33.064322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000841    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000844    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000846    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000849    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000851    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000854    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000856    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000859    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000861    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000864    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000867    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000869    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000872    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000875    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000877    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000880    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000883    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000885    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000891    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000894    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 20:34:33.064850 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000897    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000900    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000902    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000906    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000908    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000911    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000913    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000916    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000919    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000922    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000925    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000927    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.000930    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001652    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001660    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001663    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001667    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001672    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001675    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001677    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 20:34:33.065417 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001681    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001683    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001686    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001689    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001691    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001695    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001698    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001701    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001703    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001706    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001708    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001711    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001714    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001717    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001719    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001722    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001725    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001728    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001731    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001734    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 20:34:33.065973 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001736    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001739    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001742    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001745    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001748    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001751    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001753    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001756    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001758    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001761    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001763    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001766    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001768    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001773    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001776    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001779    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001781    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001784    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001787    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 20:34:33.066567 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001789    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001793    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001796    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001800    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001804    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001807    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001809    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001812    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001815    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001818    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001820    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001822    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001825    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001828    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001830    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001833    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001835    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001838    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001840    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 20:34:33.067097 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001843    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001847    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001849    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001852    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001854    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001857    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001859    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001862    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001865    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001867    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001870    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001873    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001876    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001879    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001881    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001884    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001887    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001889    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001892    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001894    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 20:34:33.067653 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001897    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001899    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001902    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001904    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001907    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001910    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001912    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001915    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001918    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001920    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001923    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001926    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001928    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.001931    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002291    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002295    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002298    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002301    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002304    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002307    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 20:34:33.068195 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002309    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002312    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002315    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002318    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002320    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002323    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002326    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002329    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002332    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002335    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002338    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002340    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002343    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002345    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002348    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002350    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002353    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002356    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002358    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002361    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 20:34:33.068828 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002364    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002366    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002369    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002371    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002397    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002400    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002403    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002405    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002408    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002411    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002413    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002417    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002420    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002422    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002425    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002427    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002430    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002435    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002439    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 20:34:33.069410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002442    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002445    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002449    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002452    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002455    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002457    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002460    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002463    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002466    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002469    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002472    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002475    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002477    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002482    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002485    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002487    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002490    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002495    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002499    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002502    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 20:34:33.069969 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002505    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002507    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002510    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002513    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002515    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002517    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002521    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002523    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002526    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002528    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002531    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002535    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002538    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002540    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002543    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002546    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002548    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002550    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002553    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 20:34:33.071133 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002556    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002558    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002561    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002563    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002566    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002568    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002572    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002575    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002577    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002580    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002585    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002588    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002590    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002593    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.002596    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002664    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002671    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002678    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002682    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002686    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002689    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 20:34:33.071713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002693    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002698    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002701    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002704    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002708    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002712    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002715    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002718    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002721    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002724    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002727    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002730    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002734    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002736    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002739    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002742    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002745    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002750    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002753    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002756    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002760    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002764    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002767    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002770    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 20:34:33.207553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002773    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 20:34:33.080099 ip-10-0-139-118 systemd[1]: Started Kubernetes Kubelet.
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002776    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002780    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002783    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002786    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002788    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002791    2571 flags.go:64] FLAG: --enable-server="true"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002794    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002799    2571 flags.go:64] FLAG: --event-burst="100"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002802    2571 flags.go:64] FLAG: --event-qps="50"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002805    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002808    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002810    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002814    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002817    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002820    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002823    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002826    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002829    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002832    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002835    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002838    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002841    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002844    2571 flags.go:64] FLAG: --feature-gates=""
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002847    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 20:34:33.228903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002852    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002855    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002858    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002861    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002865    2571 flags.go:64] FLAG: --help="false"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002868    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002871    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002874    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002877    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002880    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002883    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002886    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002889    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002904    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002907    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002910    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002913    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002916    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002919    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002923    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002926    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002928    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002932    2571 flags.go:64] FLAG: --lock-file=""
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002935    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 20:34:33.229893 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002938    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002941    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002946    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002949    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002952    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002955    2571 flags.go:64] FLAG: --logging-format="text"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002957    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002961    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002966    2571 flags.go:64] FLAG: --manifest-url=""
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002968    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002973    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002976    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002981    2571 flags.go:64] FLAG: --max-pods="110"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002984    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002987    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002989    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002992    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002995    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.002998    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003001    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003008    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003011    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003013    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 20:34:33.230761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003016    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003019    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003025    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003027    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003030    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003033    2571 flags.go:64] FLAG: --port="10250"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003036    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003039    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-020308365d4afe0e8"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003043    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003046    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003049    2571 flags.go:64] FLAG: --register-node="true"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003051    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003055    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003058    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003061    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003063    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003067    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003072    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003074    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003077    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003080    2571 flags.go:64] FLAG: --runonce="false"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003083    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003087    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003090    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003093    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 20:34:33.231876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003096    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003099    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003102    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003105    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003108    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003111    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003114    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003116    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003119    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003122    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003125    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003130    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003133    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003136    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003140    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003142    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003146    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003149    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003152    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003155    2571 flags.go:64] FLAG: --v="2"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003158    2571 flags.go:64] FLAG: --version="false"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003162    2571 flags.go:64] FLAG: --vmodule=""
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003165    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.003168    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003287    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 20:34:33.232714 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003291    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003294    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003296    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003299    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003303    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003306    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003308    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003311    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003314    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003316    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003319    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003321    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003324    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003326    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003329    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003331    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003334    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003336    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003339    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003341    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 20:34:33.233766 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003344    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003346    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003349    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003352    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003355    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003358    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003360    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003363    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003365    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003368    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003370    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003375    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003391    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003394    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003398    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003402    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003415    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003419    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003423    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 20:34:33.234796 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003426    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003429    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003432    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003435    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003437    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003440    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003442    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003445    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003448    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003450    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003453    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003455    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003458    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003460    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003463    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003465    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003468    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003470    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003473    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 20:34:33.235421 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003476    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003479    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003481    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003484    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003486    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003490    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003492    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003495    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003498    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003500    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003504    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003506    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003509    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003512    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003514    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003517    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003519    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003522    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003525    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003528    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 20:34:33.236042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003530    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003533    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003535    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003538    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003540    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003542    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003545    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003547    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003550    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003553    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003555    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003557    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003560    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003563    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003565    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003568    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003570    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003574    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003577    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 20:34:33.236647 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.003579    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.004274    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.012837    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.012855    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.013737    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.013745    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013801    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013807    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013810    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013814    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013817    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013820    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013823    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013826    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 20:34:33.237243 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013830    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013834    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013837    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013840    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013843    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013847    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013849    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013852    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013855    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013858    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013860    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013863    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013866    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013869    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013872    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013874    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013877    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013880    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013882    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 20:34:33.237722 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013885    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013893    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013896    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013900    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013903    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013905    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013908    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013910    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013914    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013917    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013919    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013923    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013926    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013929    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013931    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013934    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013937    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013939    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013942    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013944    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 20:34:33.238264 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013947    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013950    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013953    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013955    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013957    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013960    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013962    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013965    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013970    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013973    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013975    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013978    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013980    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013983    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013985    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013988    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013990    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013993    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013995    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.013998    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 20:34:33.238822 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014005    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014007    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014010    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014012    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014015    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014017    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014020    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014022    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014025    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014027    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014031    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014035    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014038    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014041    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014044    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014046    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014049    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014051    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014054    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 20:34:33.239432 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014057    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014062    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014065    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014068    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014071    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014073    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014076    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014078    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014081    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014083    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014086    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014089    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014091    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.014098    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 20:34:33.239946 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014217    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014223    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014226    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014228    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014231    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014234    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014237    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014240    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014243    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014245    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014248    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014251    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014254    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014256    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014258    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014261    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014263    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014266    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014268    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014275    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 20:34:33.240410 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014277    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014281    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014285    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014288    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014291    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014294    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014297    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014301    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014304    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014307    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014309    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014312    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014316    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014319    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014322    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014324    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014327    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014330    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014333    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014335    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 20:34:33.240934 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014338    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014341    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014343    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014346    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014350    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014353    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014355    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014357    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014360    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014362    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014365    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014370    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014373    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014389    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014393    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014395    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014398    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014401    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014403    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 20:34:33.241537 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014406    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014408    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014411    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014413    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014416    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014420    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014424    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014426    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014429    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014431    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014434    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014436    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014440    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014442    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014445    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014447    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014450    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014452    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014455    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014458    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 20:34:33.242334 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014460    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014463    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014465    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014468    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014472    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014474    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014477    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014479    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014482    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014484    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014487    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014489    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014492    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014494    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014496    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014499    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014502    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014505    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014508    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 20:34:33.380352 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:33.014512    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.014517    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.014642    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.017184    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.018496    2571 server.go:1019] "Starting client certificate rotation"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.018597    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.018668    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.020818    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.024349    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.037450    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.041399    2571 log.go:25] "Validated CRI v1 image API"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.042213    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 20:34:33.384834 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.049510    2571 fs.go:135] Filesystem UUIDs: map[0c600644-cd20-411f-9063-3331da95243b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 be2e644a-6eec-4e97-be9b-252df23c83f5:/dev/nvme0n1p4]
Jul 10 20:34:33.385308 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.049525    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 20:34:33.385308 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.053617    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.055550    2571 manager.go:216] Machine: {Timestamp:2026-07-10 20:34:33.054365904 +0000 UTC m=+0.359365609 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101813 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ed61fa96b6e330ad8968b690d72db SystemUUID:ec2ed61f-a96b-6e33-0ad8-968b690d72db BootID:e396c849-33ff-4660-8d06-fb658bc75057 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b4:d0:59:35:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b4:d0:59:35:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:c6:ed:9c:4d:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.055651    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.055734    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.058595    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.058618    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.064173    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.064184    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.064192    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.064965    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.066152    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069486    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069610    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069645    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069657    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069674    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069683    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.069694    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 20:34:33.385524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.070040    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.070055    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.072232    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074531    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074558    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074717    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074735    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074744    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074752    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074764    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.074773    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.075238    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.075247    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.075254    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.075261    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.075270    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.075278    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.076056    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.076063    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.079325    2571 server.go:1268] "Started kubelet"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.079702    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.081169    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.081028    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.081496    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.081545    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.082308    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.082302    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.082777    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.085888    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-118.ec2.internal.18c107f442304b4b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-118.ec2.internal,UID:ip-10-0-139-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-118.ec2.internal,},FirstTimestamp:2026-07-10 20:34:33.079302987 +0000 UTC m=+0.384302687,LastTimestamp:2026-07-10 20:34:33.079302987 +0000 UTC m=+0.384302687,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-118.ec2.internal,}"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.087351    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.088166    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.088178    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.088245    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.089210    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.089219    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.089242    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.089418    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.089428    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 20:34:33.386089 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.101686    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.102252    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmgmf"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.102253    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.102371    2571 factory.go:55] Registering systemd factory
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.102420    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.102874    2571 factory.go:153] Registering CRI-O factory
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.102890    2571 factory.go:223] Registration of the crio container factory successfully
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.103257    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.103280    2571 factory.go:103] Registering Raw factory
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.103291    2571 manager.go:1196] Started watching for new ooms in manager
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.103717    2571 manager.go:349] Starting recovery of all containers
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.112057    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmgmf"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.114095    2571 manager.go:354] Recovery completed
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.119271    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121059    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121087    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121097    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121519    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121527    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121541    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.121571    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.122249    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.122282    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.122291    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.122701    2571 policy_none.go:49] "None policy: Start"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.122716    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.122727    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.123669    2571 policy_none.go:47] "Start"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.128542    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-118.ec2.internal.18c107f444ada41c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-118.ec2.internal,UID:ip-10-0-139-118.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-118.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-118.ec2.internal,},FirstTimestamp:2026-07-10 20:34:33.121072156 +0000 UTC m=+0.426071856,LastTimestamp:2026-07-10 20:34:33.121072156 +0000 UTC m=+0.426071856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-118.ec2.internal,}"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.176829    2571 manager.go:337] "Starting Device Plugin manager"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.176990    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.177005    2571 server.go:87] "Starting device plugin registration server"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.177206    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.177215    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.177369    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.177477    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.177485    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.177885    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.177924    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.216955    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.218115    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.218156    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 20:34:33.387161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.218185    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.218225    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.220335    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.277869    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.278708    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.278735    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.278749    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.278776    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.292408    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.292425    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-118.ec2.internal\": node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.318564    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"]
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.318649    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.319499    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.319526    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.319540    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325113    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325233    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325263    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325740    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325750    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325762    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325771    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325773    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.325786    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.327017    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.327037    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.327646    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.327665    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.327674    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeHasSufficientPID"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.330675    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.363254    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-118.ec2.internal\" not found" node="ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.388711 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:33.367520    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-118.ec2.internal\" not found" node="ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.390844 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.390248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b703d61f62637314a00243574cfbb4d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"b703d61f62637314a00243574cfbb4d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.390844 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.390281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b703d61f62637314a00243574cfbb4d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"b703d61f62637314a00243574cfbb4d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:33.390844 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:33.390305    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df8c9063ff2754bc27e9321d0dd6e39b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-118.ec2.internal\" (UID: \"df8c9063ff2754bc27e9321d0dd6e39b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:34.895886    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:34.955055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b703d61f62637314a00243574cfbb4d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"b703d61f62637314a00243574cfbb4d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:34.955096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b703d61f62637314a00243574cfbb4d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"b703d61f62637314a00243574cfbb4d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:34.955114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df8c9063ff2754bc27e9321d0dd6e39b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-118.ec2.internal\" (UID: \"df8c9063ff2754bc27e9321d0dd6e39b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:34.955156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df8c9063ff2754bc27e9321d0dd6e39b-config\") pod \"kube-apiserver-proxy-ip-10-0-139-118.ec2.internal\" (UID: \"df8c9063ff2754bc27e9321d0dd6e39b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:34.955163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b703d61f62637314a00243574cfbb4d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"b703d61f62637314a00243574cfbb4d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:34.973101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:34.955180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b703d61f62637314a00243574cfbb4d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal\" (UID: \"b703d61f62637314a00243574cfbb4d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:35.104528 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:34.996290    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:35.104528 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.096912    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:35.211761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.135087    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:35.211761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.135089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:35.211761 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.198021    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:35.312983 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.302241    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-118.ec2.internal\" not found"
Jul 10 20:34:35.435458 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.369289    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.453370    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.465712    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.467669    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.475361    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.482509    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.482612    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.482645    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.534266    2571 apiserver.go:52] "Watching apiserver"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.536540    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.542692    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.545591    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-xhzc2","kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal","openshift-image-registry/node-ca-dq8zn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-9pgtq","openshift-multus/multus-rfnwc","openshift-multus/network-metrics-daemon-l478j","kube-system/global-pull-secret-syncer-p55qj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9","openshift-cluster-node-tuning-operator/tuned-r842r","openshift-dns/node-resolver-nzd67","openshift-network-diagnostics/network-check-target-ff8xx","openshift-network-operator/iptables-alerter-vxztq","openshift-ovn-kubernetes/ovnkube-node-p76js"]
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.547126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.548268    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.549296    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.549504    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.549559    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.549581    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.549621    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rfspx\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.550734    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.550744    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.550766    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6vcb9\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.550749    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.551025    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.551107    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.551978    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.552780    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.553198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.553253    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.557788    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.558291    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.573413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.558335    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.558578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.558800    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.559083    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qqjrn\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.559194    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.559372    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.559518    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.559540    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l8kjk\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.559600    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.560120    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.560235    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.560325    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bnxbw\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.562519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.562812    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f57gp\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.562952    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.563003    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.563839    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.563891    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.564694    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.564823    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4mwhm\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.564831    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.564971    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.565031    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566127    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98aac43a-543e-4b20-8795-82794a28b7a9-serviceca\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb5mn\" (UniqueName: \"kubernetes.io/projected/98aac43a-543e-4b20-8795-82794a28b7a9-kube-api-access-fb5mn\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71bb5765-56a2-4ed9-a356-45835d6f9d5b-host-slash\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.574962 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-socket-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-device-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-sys-fs\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-ovnkube-config\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq24x\" (UniqueName: \"kubernetes.io/projected/71bb5765-56a2-4ed9-a356-45835d6f9d5b-kube-api-access-bq24x\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566446    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-registration-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ec479f9-a54e-4141-a556-c0476391b7a3-ovn-node-metrics-cert\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98aac43a-543e-4b20-8795-82794a28b7a9-host\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566518    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b550a91-8e4b-4702-a2b5-bddd4615eea9-agent-certs\") pod \"konnectivity-agent-xhzc2\" (UID: \"5b550a91-8e4b-4702-a2b5-bddd4615eea9\") " pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71bb5765-56a2-4ed9-a356-45835d6f9d5b-iptables-alerter-script\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-log-socket\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566623    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-etc-selinux\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566638    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k7mw\" (UniqueName: \"kubernetes.io/projected/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-kube-api-access-7k7mw\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvhzz\" (UniqueName: \"kubernetes.io/projected/0bff3f7e-55ab-4915-8ea8-6148ac876e50-kube-api-access-hvhzz\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.575867 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566734    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-systemd-units\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnvx\" (UniqueName: \"kubernetes.io/projected/6ec479f9-a54e-4141-a556-c0476391b7a3-kube-api-access-bcnvx\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566797    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-run-netns\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-cni-bin\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566865    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b550a91-8e4b-4702-a2b5-bddd4615eea9-konnectivity-ca\") pod \"konnectivity-agent-xhzc2\" (UID: \"5b550a91-8e4b-4702-a2b5-bddd4615eea9\") " pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-systemd\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566955    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-env-overrides\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.566986    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-node-log\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bff3f7e-55ab-4915-8ea8-6148ac876e50-hosts-file\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-kubelet\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-var-lib-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-ovn\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff3f7e-55ab-4915-8ea8-6148ac876e50-tmp-dir\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.577136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-slash\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-etc-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-cni-netd\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.567356    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.568343    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.568470    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lchzf\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.568652    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.568832    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.568937    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.574382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-ovnkube-script-lib\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.574508    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.574522    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 20:34:35.577980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.574509    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-26bht\""
Jul 10 20:34:35.580830 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.580515    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 20:29:34 +0000 UTC" deadline="2028-04-03 05:56:06.968296096 +0000 UTC"
Jul 10 20:34:35.580830 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.580561    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15177h21m31.387738285s"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.599538    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdsf7"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.606794    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdsf7"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.654518    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-slash\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-etc-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-cni-netd\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb5mn\" (UniqueName: \"kubernetes.io/projected/98aac43a-543e-4b20-8795-82794a28b7a9-kube-api-access-fb5mn\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674949    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71bb5765-56a2-4ed9-a356-45835d6f9d5b-host-slash\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-socket-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674990    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-cni-netd\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675010    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-slash\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.674991    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-etc-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71bb5765-56a2-4ed9-a356-45835d6f9d5b-host-slash\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675047    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-ovnkube-config\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-socket-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56b32a88-b39f-4ca1-ad34-c757b5d33edd-cni-binary-copy\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-k8s-cni-cncf-io\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.697314 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-netns\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-registration-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675150    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675185    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-kubernetes\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-registration-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675214    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-systemd\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-cni-multus\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-daemon-config\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675330    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rml2m\" (UniqueName: \"kubernetes.io/projected/3b5e65ae-4b6d-448f-b752-4a0535d4e586-kube-api-access-rml2m\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675379    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-modprobe-d\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675452    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cnibin\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh844\" (UniqueName: \"kubernetes.io/projected/6ff77c55-7c1f-4c96-b82e-5461972b50ac-kube-api-access-rh844\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-hostroot\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.698241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-run-netns\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-cni-bin\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-socket-dir-parent\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-systemd\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-env-overrides\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-ovnkube-config\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675595    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-cni-bin\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ff77c55-7c1f-4c96-b82e-5461972b50ac-tmp\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675629    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-run-netns\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bff3f7e-55ab-4915-8ea8-6148ac876e50-hosts-file\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-systemd\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-os-release\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-etc-kubernetes\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0bff3f7e-55ab-4915-8ea8-6148ac876e50-hosts-file\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-ovnkube-script-lib\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.699146 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675781    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98aac43a-543e-4b20-8795-82794a28b7a9-serviceca\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq24x\" (UniqueName: \"kubernetes.io/projected/71bb5765-56a2-4ed9-a356-45835d6f9d5b-kube-api-access-bq24x\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysctl-conf\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-lib-modules\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-var-lib-kubelet\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675857    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-host\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675871    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-cnibin\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-device-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675927    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-sys-fs\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-system-cni-dir\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-env-overrides\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.675989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-device-dir\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676015    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-sys-fs\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676043    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-sys\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676098    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-os-release\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ec479f9-a54e-4141-a556-c0476391b7a3-ovn-node-metrics-cert\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.700054 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676141    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98aac43a-543e-4b20-8795-82794a28b7a9-host\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b550a91-8e4b-4702-a2b5-bddd4615eea9-agent-certs\") pod \"konnectivity-agent-xhzc2\" (UID: \"5b550a91-8e4b-4702-a2b5-bddd4615eea9\") " pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71bb5765-56a2-4ed9-a356-45835d6f9d5b-iptables-alerter-script\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676207    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/98aac43a-543e-4b20-8795-82794a28b7a9-serviceca\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676210    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ec479f9-a54e-4141-a556-c0476391b7a3-ovnkube-script-lib\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676271    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98aac43a-543e-4b20-8795-82794a28b7a9-host\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676316    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq25n\" (UniqueName: \"kubernetes.io/projected/7082368f-d1a2-4abb-8afe-5e2a09d5664a-kube-api-access-xq25n\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysconfig\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676369    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-cni-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-log-socket\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-etc-selinux\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676426    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-cni-bin\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676513    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-kubelet\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.701118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-log-socket\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k7mw\" (UniqueName: \"kubernetes.io/projected/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-kube-api-access-7k7mw\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676480    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-etc-selinux\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvhzz\" (UniqueName: \"kubernetes.io/projected/0bff3f7e-55ab-4915-8ea8-6148ac876e50-kube-api-access-hvhzz\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-systemd-units\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnvx\" (UniqueName: \"kubernetes.io/projected/6ec479f9-a54e-4141-a556-c0476391b7a3-kube-api-access-bcnvx\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71bb5765-56a2-4ed9-a356-45835d6f9d5b-iptables-alerter-script\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676683    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-conf-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-systemd-units\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b550a91-8e4b-4702-a2b5-bddd4615eea9-konnectivity-ca\") pod \"konnectivity-agent-xhzc2\" (UID: \"5b550a91-8e4b-4702-a2b5-bddd4615eea9\") " pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-system-cni-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c380fc70-5a8a-4390-9e39-1b2113fd658b-dbus\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysctl-d\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-run\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.702043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvwwr\" (UniqueName: \"kubernetes.io/projected/56b32a88-b39f-4ca1-ad34-c757b5d33edd-kube-api-access-cvwwr\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-node-log\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-kubelet\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-var-lib-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.676989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-node-log\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-var-lib-openvswitch\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-host-kubelet\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677054    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-ovn\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c380fc70-5a8a-4390-9e39-1b2113fd658b-kubelet-config\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677112    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ec479f9-a54e-4141-a556-c0476391b7a3-run-ovn\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-tuned\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677151    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-multus-certs\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677175    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff3f7e-55ab-4915-8ea8-6148ac876e50-tmp-dir\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b550a91-8e4b-4702-a2b5-bddd4615eea9-konnectivity-ca\") pod \"konnectivity-agent-xhzc2\" (UID: \"5b550a91-8e4b-4702-a2b5-bddd4615eea9\") " pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.677461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bff3f7e-55ab-4915-8ea8-6148ac876e50-tmp-dir\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.679514    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ec479f9-a54e-4141-a556-c0476391b7a3-ovn-node-metrics-cert\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.679605    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b550a91-8e4b-4702-a2b5-bddd4615eea9-agent-certs\") pod \"konnectivity-agent-xhzc2\" (UID: \"5b550a91-8e4b-4702-a2b5-bddd4615eea9\") " pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.702706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.686809    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb5mn\" (UniqueName: \"kubernetes.io/projected/98aac43a-543e-4b20-8795-82794a28b7a9-kube-api-access-fb5mn\") pod \"node-ca-dq8zn\" (UID: \"98aac43a-543e-4b20-8795-82794a28b7a9\") " pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.686997    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.687014    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.687025    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.687083    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:34:36.187065626 +0000 UTC m=+2.027786356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.688816    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq24x\" (UniqueName: \"kubernetes.io/projected/71bb5765-56a2-4ed9-a356-45835d6f9d5b-kube-api-access-bq24x\") pod \"iptables-alerter-vxztq\" (UID: \"71bb5765-56a2-4ed9-a356-45835d6f9d5b\") " pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.689098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvhzz\" (UniqueName: \"kubernetes.io/projected/0bff3f7e-55ab-4915-8ea8-6148ac876e50-kube-api-access-hvhzz\") pod \"node-resolver-nzd67\" (UID: \"0bff3f7e-55ab-4915-8ea8-6148ac876e50\") " pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.689232    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnvx\" (UniqueName: \"kubernetes.io/projected/6ec479f9-a54e-4141-a556-c0476391b7a3-kube-api-access-bcnvx\") pod \"ovnkube-node-p76js\" (UID: \"6ec479f9-a54e-4141-a556-c0476391b7a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.689296    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k7mw\" (UniqueName: \"kubernetes.io/projected/bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3-kube-api-access-7k7mw\") pod \"aws-ebs-csi-driver-node-d5mq9\" (UID: \"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.703358 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.697092    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nzd67"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.765535    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ff77c55-7c1f-4c96-b82e-5461972b50ac-tmp\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777528    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-os-release\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-etc-kubernetes\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777562    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysctl-conf\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-lib-modules\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-var-lib-kubelet\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777616    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-etc-kubernetes\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-host\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-cnibin\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-var-lib-kubelet\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777703    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-os-release\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777715    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-system-cni-dir\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-lib-modules\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777741    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysctl-conf\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-system-cni-dir\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.829408 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777738    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-host\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-cnibin\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-sys\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777836    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-os-release\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-sys\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-os-release\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq25n\" (UniqueName: \"kubernetes.io/projected/7082368f-d1a2-4abb-8afe-5e2a09d5664a-kube-api-access-xq25n\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysconfig\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-cni-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.777981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-cni-bin\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-kubelet\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysconfig\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-conf-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-kubelet\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-cni-bin\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-system-cni-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.831419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c380fc70-5a8a-4390-9e39-1b2113fd658b-dbus\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-conf-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysctl-d\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-run\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778197    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-cni-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778198    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvwwr\" (UniqueName: \"kubernetes.io/projected/56b32a88-b39f-4ca1-ad34-c757b5d33edd-kube-api-access-cvwwr\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c380fc70-5a8a-4390-9e39-1b2113fd658b-kubelet-config\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778261    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-system-cni-dir\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778275    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-tuned\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-multus-certs\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c380fc70-5a8a-4390-9e39-1b2113fd658b-kubelet-config\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.778340    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c380fc70-5a8a-4390-9e39-1b2113fd658b-dbus\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56b32a88-b39f-4ca1-ad34-c757b5d33edd-cni-binary-copy\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778386    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778396    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-multus-certs\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832024 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-k8s-cni-cncf-io\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.778411    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:34:36.278392152 +0000 UTC m=+2.119112883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-k8s-cni-cncf-io\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778469    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-run\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-netns\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778548    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-sysctl-d\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-run-netns\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-kubernetes\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-systemd\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-cni-multus\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cni-binary-copy\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778739    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-daemon-config\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778734    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-kubernetes\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-systemd\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778759    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rml2m\" (UniqueName: \"kubernetes.io/projected/3b5e65ae-4b6d-448f-b752-4a0535d4e586-kube-api-access-rml2m\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:35.832684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-host-var-lib-cni-multus\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-modprobe-d\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778820    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cnibin\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778869    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh844\" (UniqueName: \"kubernetes.io/projected/6ff77c55-7c1f-4c96-b82e-5461972b50ac-kube-api-access-rh844\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-hostroot\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-socket-dir-parent\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-modprobe-d\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cnibin\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-socket-dir-parent\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.778998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7082368f-d1a2-4abb-8afe-5e2a09d5664a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.779037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56b32a88-b39f-4ca1-ad34-c757b5d33edd-hostroot\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.779056    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:35.779110    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:34:36.279094907 +0000 UTC m=+2.119815642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.779385    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56b32a88-b39f-4ca1-ad34-c757b5d33edd-cni-binary-copy\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.779425    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56b32a88-b39f-4ca1-ad34-c757b5d33edd-multus-daemon-config\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.779815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ff77c55-7c1f-4c96-b82e-5461972b50ac-tmp\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.833234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.780593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ff77c55-7c1f-4c96-b82e-5461972b50ac-etc-tuned\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.786792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq25n\" (UniqueName: \"kubernetes.io/projected/7082368f-d1a2-4abb-8afe-5e2a09d5664a-kube-api-access-xq25n\") pod \"multus-additional-cni-plugins-9pgtq\" (UID: \"7082368f-d1a2-4abb-8afe-5e2a09d5664a\") " pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.786809    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvwwr\" (UniqueName: \"kubernetes.io/projected/56b32a88-b39f-4ca1-ad34-c757b5d33edd-kube-api-access-cvwwr\") pod \"multus-rfnwc\" (UID: \"56b32a88-b39f-4ca1-ad34-c757b5d33edd\") " pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.794039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh844\" (UniqueName: \"kubernetes.io/projected/6ff77c55-7c1f-4c96-b82e-5461972b50ac-kube-api-access-rh844\") pod \"tuned-r842r\" (UID: \"6ff77c55-7c1f-4c96-b82e-5461972b50ac\") " pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.794214    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rml2m\" (UniqueName: \"kubernetes.io/projected/3b5e65ae-4b6d-448f-b752-4a0535d4e586-kube-api-access-rml2m\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.817000    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb703d61f62637314a00243574cfbb4d8.slice/crio-1d7eb97b6a24e02f733c56c47b0362db8d920454c5d713dc75ac15f2256ed807 WatchSource:0}: Error finding container 1d7eb97b6a24e02f733c56c47b0362db8d920454c5d713dc75ac15f2256ed807: Status 404 returned error can't find the container with id 1d7eb97b6a24e02f733c56c47b0362db8d920454c5d713dc75ac15f2256ed807
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.817399    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8c9063ff2754bc27e9321d0dd6e39b.slice/crio-f2d3f448d64e65a78429eae172db0b8c24ce02d7f9e635234d53713c91186644 WatchSource:0}: Error finding container f2d3f448d64e65a78429eae172db0b8c24ce02d7f9e635234d53713c91186644: Status 404 returned error can't find the container with id f2d3f448d64e65a78429eae172db0b8c24ce02d7f9e635234d53713c91186644
Jul 10 20:34:35.833869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.821684    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.882312    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9"
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.894792    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8d9e1a_6cc8_4768_8bfc_01eefb8f8ad3.slice/crio-54f763b97f63771b8ac051671426812c3a729b31c7412aeb915810e5866a96b1 WatchSource:0}: Error finding container 54f763b97f63771b8ac051671426812c3a729b31c7412aeb915810e5866a96b1: Status 404 returned error can't find the container with id 54f763b97f63771b8ac051671426812c3a729b31c7412aeb915810e5866a96b1
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.903134    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.912100    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec479f9_a54e_4141_a556_c0476391b7a3.slice/crio-d62e6eb84d36015cf781b99c2322a393d557785fa3b2079301dd987352f42ce7 WatchSource:0}: Error finding container d62e6eb84d36015cf781b99c2322a393d557785fa3b2079301dd987352f42ce7: Status 404 returned error can't find the container with id d62e6eb84d36015cf781b99c2322a393d557785fa3b2079301dd987352f42ce7
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.932320    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq8zn"
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.934002    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:35.942140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vxztq"
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.945514    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98aac43a_543e_4b20_8795_82794a28b7a9.slice/crio-265c2cac5f5c93ba407d493639d61fe1480d3d1ce6e102924dd71f62c1cd0a02 WatchSource:0}: Error finding container 265c2cac5f5c93ba407d493639d61fe1480d3d1ce6e102924dd71f62c1cd0a02: Status 404 returned error can't find the container with id 265c2cac5f5c93ba407d493639d61fe1480d3d1ce6e102924dd71f62c1cd0a02
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.949751    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b550a91_8e4b_4702_a2b5_bddd4615eea9.slice/crio-1252795bc970a050c716a9ad17374b6361686700f0b8161cc71c4ff7e3c721a7 WatchSource:0}: Error finding container 1252795bc970a050c716a9ad17374b6361686700f0b8161cc71c4ff7e3c721a7: Status 404 returned error can't find the container with id 1252795bc970a050c716a9ad17374b6361686700f0b8161cc71c4ff7e3c721a7
Jul 10 20:34:35.988289 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:35.950380    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bb5765_56a2_4ed9_a356_45835d6f9d5b.slice/crio-68c91887a01a21fb59a97ca176cdaa5f050989918ec75d1ca5b299b23aed9e7b WatchSource:0}: Error finding container 68c91887a01a21fb59a97ca176cdaa5f050989918ec75d1ca5b299b23aed9e7b: Status 404 returned error can't find the container with id 68c91887a01a21fb59a97ca176cdaa5f050989918ec75d1ca5b299b23aed9e7b
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.012582    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r842r"
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:36.022207    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff77c55_7c1f_4c96_b82e_5461972b50ac.slice/crio-412a3b38f5f686ee20f440d1439a4e947875d9c43e46fb304f04ffa615481aa3 WatchSource:0}: Error finding container 412a3b38f5f686ee20f440d1439a4e947875d9c43e46fb304f04ffa615481aa3: Status 404 returned error can't find the container with id 412a3b38f5f686ee20f440d1439a4e947875d9c43e46fb304f04ffa615481aa3
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.032617    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rfnwc"
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.037455    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9pgtq"
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:36.038129    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bff3f7e_55ab_4915_8ea8_6148ac876e50.slice/crio-7ba30bf1836fe165f7746bacbf7fafbc77ee78106218ad901b0f4d5f6228e828 WatchSource:0}: Error finding container 7ba30bf1836fe165f7746bacbf7fafbc77ee78106218ad901b0f4d5f6228e828: Status 404 returned error can't find the container with id 7ba30bf1836fe165f7746bacbf7fafbc77ee78106218ad901b0f4d5f6228e828
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:36.044974    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b32a88_b39f_4ca1_ad34_c757b5d33edd.slice/crio-016f41ad3ed8e56b7705c871dffa4d6b297eb8274a348e6e4449c05e27c5d919 WatchSource:0}: Error finding container 016f41ad3ed8e56b7705c871dffa4d6b297eb8274a348e6e4449c05e27c5d919: Status 404 returned error can't find the container with id 016f41ad3ed8e56b7705c871dffa4d6b297eb8274a348e6e4449c05e27c5d919
Jul 10 20:34:36.148966 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:34:36.046718    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7082368f_d1a2_4abb_8afe_5e2a09d5664a.slice/crio-30bc431f9c7c02438d786a779f835da93f609909ccdb4ae8b559b00dc357aa94 WatchSource:0}: Error finding container 30bc431f9c7c02438d786a779f835da93f609909ccdb4ae8b559b00dc357aa94: Status 404 returned error can't find the container with id 30bc431f9c7c02438d786a779f835da93f609909ccdb4ae8b559b00dc357aa94
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.283109    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.283152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.283208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.283345    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.283405    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:34:37.283386958 +0000 UTC m=+3.124107694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.283849    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.283867    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.283881    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.283934    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:34:37.283919063 +0000 UTC m=+3.124639797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.284006    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:36.287977 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.284038    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:34:37.284026568 +0000 UTC m=+3.124747306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:36.614224 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.614027    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:29:35 +0000 UTC" deadline="2027-12-28 19:43:37.784720548 +0000 UTC"
Jul 10 20:34:36.614224 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.614084    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12863h9m1.170640381s"
Jul 10 20:34:36.633804 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.633774    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 20:34:36.683905 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.683876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:36.684075 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:36.684021    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:36.703179 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.703106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9" event={"ID":"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3","Type":"ContainerStarted","Data":"54f763b97f63771b8ac051671426812c3a729b31c7412aeb915810e5866a96b1"}
Jul 10 20:34:36.713505 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.713428    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" event={"ID":"b703d61f62637314a00243574cfbb4d8","Type":"ContainerStarted","Data":"1d7eb97b6a24e02f733c56c47b0362db8d920454c5d713dc75ac15f2256ed807"}
Jul 10 20:34:36.726345 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.726314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rfnwc" event={"ID":"56b32a88-b39f-4ca1-ad34-c757b5d33edd","Type":"ContainerStarted","Data":"016f41ad3ed8e56b7705c871dffa4d6b297eb8274a348e6e4449c05e27c5d919"}
Jul 10 20:34:36.753150 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.753117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nzd67" event={"ID":"0bff3f7e-55ab-4915-8ea8-6148ac876e50","Type":"ContainerStarted","Data":"7ba30bf1836fe165f7746bacbf7fafbc77ee78106218ad901b0f4d5f6228e828"}
Jul 10 20:34:36.777142 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.777109    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r842r" event={"ID":"6ff77c55-7c1f-4c96-b82e-5461972b50ac","Type":"ContainerStarted","Data":"412a3b38f5f686ee20f440d1439a4e947875d9c43e46fb304f04ffa615481aa3"}
Jul 10 20:34:36.794510 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.794431    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vxztq" event={"ID":"71bb5765-56a2-4ed9-a356-45835d6f9d5b","Type":"ContainerStarted","Data":"68c91887a01a21fb59a97ca176cdaa5f050989918ec75d1ca5b299b23aed9e7b"}
Jul 10 20:34:36.827443 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.827413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhzc2" event={"ID":"5b550a91-8e4b-4702-a2b5-bddd4615eea9","Type":"ContainerStarted","Data":"1252795bc970a050c716a9ad17374b6361686700f0b8161cc71c4ff7e3c721a7"}
Jul 10 20:34:36.839244 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.839099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal" event={"ID":"df8c9063ff2754bc27e9321d0dd6e39b","Type":"ContainerStarted","Data":"f2d3f448d64e65a78429eae172db0b8c24ce02d7f9e635234d53713c91186644"}
Jul 10 20:34:36.862177 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.861875    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerStarted","Data":"30bc431f9c7c02438d786a779f835da93f609909ccdb4ae8b559b00dc357aa94"}
Jul 10 20:34:36.888942 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.888572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq8zn" event={"ID":"98aac43a-543e-4b20-8795-82794a28b7a9","Type":"ContainerStarted","Data":"265c2cac5f5c93ba407d493639d61fe1480d3d1ce6e102924dd71f62c1cd0a02"}
Jul 10 20:34:36.913363 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:36.913325    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"d62e6eb84d36015cf781b99c2322a393d557785fa3b2079301dd987352f42ce7"}
Jul 10 20:34:37.250811 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.250524    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.292254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.292331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.292358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.292483    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.292544    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:34:39.292524422 +0000 UTC m=+5.133245170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.292991    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.293042    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:34:39.293026825 +0000 UTC m=+5.133747573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.293123    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.293137    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.293149    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:37.293218 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.293184    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:34:39.293172943 +0000 UTC m=+5.133893679 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:37.614721 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.614572    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:29:35 +0000 UTC" deadline="2027-12-27 08:13:54.292116993 +0000 UTC"
Jul 10 20:34:37.614721 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.614637    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12827h39m16.677485173s"
Jul 10 20:34:37.683707 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.683677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:37.683889 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.683803    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:37.683889 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:37.683889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:37.684009 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:37.683953    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:38.684306 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:38.683799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:38.684306 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:38.683942    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:39.309194 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:39.309107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:39.309365 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:39.309194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:39.309365 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:39.309222    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:39.309365 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309360    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:39.309529 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309422    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:34:43.309402846 +0000 UTC m=+9.150123581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:39.309835 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309813    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:39.309925 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309838    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:34:39.309925 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309860    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:34:39.309925 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309879    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:39.309925 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309882    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:34:43.309866766 +0000 UTC m=+9.150587499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:39.310134 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.309952    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:34:43.309909774 +0000 UTC m=+9.150630519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:39.683117 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:39.683036    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:39.683329 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.683183    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:39.683580 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:39.683562    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:39.683693 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:39.683672    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:40.683012 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:40.682977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:40.683498 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:40.683254    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:41.683304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:41.683222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:41.683772 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:41.683394    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:41.683772 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:41.683223    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:41.683875 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:41.683801    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:42.683201 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:42.683160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:42.683358 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:42.683325    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:43.345407 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:43.345373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:43.345579 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:43.345436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:43.345579 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:43.345463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:43.345579 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345539    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345581    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345605    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345615    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:34:51.345595269 +0000 UTC m=+17.186316015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345622    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345634    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345638    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:34:51.345626555 +0000 UTC m=+17.186347286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:43.345804 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.345688    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:34:51.345673339 +0000 UTC m=+17.186394069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:43.683118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:43.683028    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:43.683118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:43.683085    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:43.683347 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.683191    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:43.683412 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:43.683328    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:44.685871 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:44.685841    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:44.686327 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:44.685982    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:45.683463 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:45.683427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:45.683682 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:45.683571    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:45.683682 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:45.683629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:45.683814 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:45.683762    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:46.683599 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:46.683559    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:46.684070 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:46.683714    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:47.683021 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:47.682940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:47.683184 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:47.682940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:47.683184 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:47.683063    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:47.683184 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:47.683159    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:48.683388 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:48.683357    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:48.683858 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:48.683501    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:49.682882 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:49.682845    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:49.683067 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:49.682850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:49.683067 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:49.682966    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:49.683153 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:49.683062    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:50.682901 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:50.682867    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:50.683353 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:50.683006    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:51.409337 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:51.409302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:51.409354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:51.409375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409467    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409472    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409487    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409506    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409515    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409520    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:07.409502958 +0000 UTC m=+33.250223688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:34:51.409545 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409539    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:35:07.409529169 +0000 UTC m=+33.250249900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:34:51.409940 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.409556    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:35:07.40954719 +0000 UTC m=+33.250267922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:34:51.683320 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:51.683242    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:51.683653 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.683344    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:51.683653 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:51.683397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:51.683653 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:51.683477    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:52.682930 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:52.682895    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:52.683099 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:52.683031    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:53.682845 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:53.682808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:53.683320 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:53.682808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:53.683320 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:53.682942    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:53.683320 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:53.683053    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:54.684259 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:54.684032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:54.684723 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:54.684362    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:55.682921 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:55.682886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:55.683093 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:55.682999    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:55.683093 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:55.683033    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:55.683199 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:55.683106    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:56.683384 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.683291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:56.683776 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:56.683441    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:56.962779 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.962600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerStarted","Data":"5c6583df1308a6ab80f9f90a42518e5bed668dd566ee762eae6d9c67bc0f18d5"}
Jul 10 20:34:56.964873 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.964846    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq8zn" event={"ID":"98aac43a-543e-4b20-8795-82794a28b7a9","Type":"ContainerStarted","Data":"1a067941d9d6330d576daa28298ddddf312bd10ab4b50be519134e216d6fb787"}
Jul 10 20:34:56.967269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967253    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:34:56.967563 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967544    2571 generic.go:356] "Generic (PLEG): container finished" podID="6ec479f9-a54e-4141-a556-c0476391b7a3" containerID="c3e88e6db07267d1c8bfa20a7bfd1829800b93f505e35f6d87657b445194a6d4" exitCode=1
Jul 10 20:34:56.967626 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967611    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"2e10dee3986eb01cd6dc9e735a59f5a691bbf356dd8a2f1feb30666a830cb67c"}
Jul 10 20:34:56.967718 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"3ea281d6cc5584f1729d8d3bb8793d6a69c136ee45d74c56885c9a86b078bd87"}
Jul 10 20:34:56.967776 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"ddab9057cfb17fa4a32939bdda7e72117490602f63cfb096a56fb5feb2923a34"}
Jul 10 20:34:56.967825 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerDied","Data":"c3e88e6db07267d1c8bfa20a7bfd1829800b93f505e35f6d87657b445194a6d4"}
Jul 10 20:34:56.967865 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.967855    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"d9d0a14e8965737308c0422f86e30a9522a42285017710ead4d742203e3d4405"}
Jul 10 20:34:56.968773 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.968755    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9" event={"ID":"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3","Type":"ContainerStarted","Data":"604998240ae13b0b8aaa7824c0ec1208e7a571bedcf8dfb2c19fa791c6367277"}
Jul 10 20:34:56.969922 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.969903    2571 generic.go:356] "Generic (PLEG): container finished" podID="b703d61f62637314a00243574cfbb4d8" containerID="f59728b2a9ba39af5b5e81e0d3dc2eddcac83a94960e7ec8d79976b1ab37a020" exitCode=0
Jul 10 20:34:56.969985 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.969961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" event={"ID":"b703d61f62637314a00243574cfbb4d8","Type":"ContainerDied","Data":"f59728b2a9ba39af5b5e81e0d3dc2eddcac83a94960e7ec8d79976b1ab37a020"}
Jul 10 20:34:56.971330 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.971308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rfnwc" event={"ID":"56b32a88-b39f-4ca1-ad34-c757b5d33edd","Type":"ContainerStarted","Data":"750ae0918af6b3cb8ccfcef77d9155b0f8d86fc24fcab7c5d77d6763d3ca077b"}
Jul 10 20:34:56.972676 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.972630    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nzd67" event={"ID":"0bff3f7e-55ab-4915-8ea8-6148ac876e50","Type":"ContainerStarted","Data":"62faa3744de903dcf3137820df8db2c8b510c92f26536568d53223645c611696"}
Jul 10 20:34:56.973993 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.973973    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r842r" event={"ID":"6ff77c55-7c1f-4c96-b82e-5461972b50ac","Type":"ContainerStarted","Data":"914b8391ca4a6a9f5997f08cd6ed779e871b91f55aa1b614f14a127f4d64ded8"}
Jul 10 20:34:56.975247 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.975228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xhzc2" event={"ID":"5b550a91-8e4b-4702-a2b5-bddd4615eea9","Type":"ContainerStarted","Data":"e10360e9364e721530bd1326d6f81c0ad1323963ac5e6261602b658231127483"}
Jul 10 20:34:56.976444 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:56.976423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal" event={"ID":"df8c9063ff2754bc27e9321d0dd6e39b","Type":"ContainerStarted","Data":"92d265feb6fc8c956c2bb17bf8a232fdbd4b00807acf53c85ffb77b7c5836eb2"}
Jul 10 20:34:57.014529 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.014323    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xhzc2" podStartSLOduration=7.452054278 podStartE2EDuration="23.014307851s" totalImagesPullingTime="15.562253573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:57.013962668 +0000 UTC m=+22.854683420" watchObservedRunningTime="2026-07-10 20:34:57.014307851 +0000 UTC m=+22.855028604"
Jul 10 20:34:57.048056 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.048010    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-118.ec2.internal" podStartSLOduration=22.047994887 podStartE2EDuration="22.047994887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:57.047938881 +0000 UTC m=+22.888659636" watchObservedRunningTime="2026-07-10 20:34:57.047994887 +0000 UTC m=+22.888715644"
Jul 10 20:34:57.048209 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.048190    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rfnwc" podStartSLOduration=1.487445026 podStartE2EDuration="22.048184022s" totalImagesPullingTime="20.560738996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:57.031086713 +0000 UTC m=+22.871807482" watchObservedRunningTime="2026-07-10 20:34:57.048184022 +0000 UTC m=+22.888904773"
Jul 10 20:34:57.077756 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.077717    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nzd67" podStartSLOduration=2.856132195 podStartE2EDuration="23.077704506s" totalImagesPullingTime="20.221572311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:57.077534068 +0000 UTC m=+22.918254821" watchObservedRunningTime="2026-07-10 20:34:57.077704506 +0000 UTC m=+22.918425258"
Jul 10 20:34:57.078007 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.077988    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dq8zn" podStartSLOduration=2.763385302 podStartE2EDuration="23.077980769s" totalImagesPullingTime="20.314595467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:57.062889053 +0000 UTC m=+22.903609804" watchObservedRunningTime="2026-07-10 20:34:57.077980769 +0000 UTC m=+22.918701511"
Jul 10 20:34:57.097724 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.097619    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r842r" podStartSLOduration=2.783931306 podStartE2EDuration="23.097607596s" totalImagesPullingTime="20.31367629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:57.097356961 +0000 UTC m=+22.938077715" watchObservedRunningTime="2026-07-10 20:34:57.097607596 +0000 UTC m=+22.938328348"
Jul 10 20:34:57.683525 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.683441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:57.684338 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:57.683564    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:57.684338 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.683636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:57.684338 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:57.683746    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:57.979572 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.979499    2571 generic.go:356] "Generic (PLEG): container finished" podID="7082368f-d1a2-4abb-8afe-5e2a09d5664a" containerID="5c6583df1308a6ab80f9f90a42518e5bed668dd566ee762eae6d9c67bc0f18d5" exitCode=0
Jul 10 20:34:57.979769 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.979578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerDied","Data":"5c6583df1308a6ab80f9f90a42518e5bed668dd566ee762eae6d9c67bc0f18d5"}
Jul 10 20:34:57.982268 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.982252    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:34:57.982628 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.982607    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"e5229a6825a26f886e35ea30f906136ff9a614f724564c999cceaf756a62ba20"}
Jul 10 20:34:57.984270 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.984252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" event={"ID":"b703d61f62637314a00243574cfbb4d8","Type":"ContainerStarted","Data":"d1f29be78a843140a7022a5c907a18c034ff863f041ada4d2a4c5d9ac2c059fc"}
Jul 10 20:34:57.985531 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:57.985512    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vxztq" event={"ID":"71bb5765-56a2-4ed9-a356-45835d6f9d5b","Type":"ContainerStarted","Data":"02bb5f5565604c3a0bb43724dc3765e075936182958a764f596fb7534371ce8c"}
Jul 10 20:34:58.011950 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.011906    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vxztq" podStartSLOduration=3.6272618469999998 podStartE2EDuration="24.011892628s" totalImagesPullingTime="20.384630781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:58.011487969 +0000 UTC m=+23.852208722" watchObservedRunningTime="2026-07-10 20:34:58.011892628 +0000 UTC m=+23.852613402"
Jul 10 20:34:58.024578 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.024534    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-118.ec2.internal" podStartSLOduration=23.024521127 podStartE2EDuration="23.024521127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:58.024404715 +0000 UTC m=+23.865125467" watchObservedRunningTime="2026-07-10 20:34:58.024521127 +0000 UTC m=+23.865241878"
Jul 10 20:34:58.186031 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.186008    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 20:34:58.659870 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.659729    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T20:34:58.186025343Z","UUID":"d6e9aed4-2ef8-4a29-ad76-720372f625aa","Handler":null,"Name":"","Endpoint":""}
Jul 10 20:34:58.661421 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.661399    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 20:34:58.661569 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.661443    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 20:34:58.683255 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.683217    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:34:58.683401 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:58.683350    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:34:58.990468 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:58.990369    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9" event={"ID":"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3","Type":"ContainerStarted","Data":"57c1c4b02227b742a31b89dc7fbd0f52811f64e1297a0fb72e132b0a96c9c785"}
Jul 10 20:34:59.683439 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:59.683410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:34:59.683552 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:59.683528    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:34:59.683604 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:59.683583    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:34:59.683738 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:34:59.683717    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:34:59.996792 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:59.996722    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:34:59.997248 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:59.997189    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"56ecdebb19c00e981b0c4e0583d1f87466fa7eeaa5c729449aef45700d1b1838"}
Jul 10 20:34:59.999757 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:34:59.999728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9" event={"ID":"bb8d9e1a-6cc8-4768-8bfc-01eefb8f8ad3","Type":"ContainerStarted","Data":"65112fae31bd410125f5f9f43739b4617864be062b91e6a748a3d422ff48e66b"}
Jul 10 20:35:00.016902 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:00.016849    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d5mq9" podStartSLOduration=3.147967014 podStartE2EDuration="26.016831829s" totalImagesPullingTime="22.868864815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:00.016638937 +0000 UTC m=+25.857359690" watchObservedRunningTime="2026-07-10 20:35:00.016831829 +0000 UTC m=+25.857552582"
Jul 10 20:35:00.683760 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:00.683727    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:00.683917 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:00.683879    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:35:01.191747 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:01.191710    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:35:01.192510 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:01.192491    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:35:01.683005 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:01.682965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:01.683005 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:01.683005    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:01.683259 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:01.683088    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:35:01.683259 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:01.683207    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:35:02.004750 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:02.004708    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:35:02.005333 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:02.005313    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xhzc2"
Jul 10 20:35:02.684000 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:02.683651    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:02.684000 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:02.683936    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:35:03.008180 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.008144    2571 generic.go:356] "Generic (PLEG): container finished" podID="7082368f-d1a2-4abb-8afe-5e2a09d5664a" containerID="f667d5349e30c117858ef03b5ecb9ce2965a00f7578e5a1fae522ac406b94143" exitCode=0
Jul 10 20:35:03.008384 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.008222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerDied","Data":"f667d5349e30c117858ef03b5ecb9ce2965a00f7578e5a1fae522ac406b94143"}
Jul 10 20:35:03.011583 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.011563    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:35:03.011994 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.011969    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"3e13f5ecacbc36fa56c6312a01cc9791db98f2c675c0237c1153500be98269ef"}
Jul 10 20:35:03.012383 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.012366    2571 scope.go:117] "RemoveContainer" containerID="c3e88e6db07267d1c8bfa20a7bfd1829800b93f505e35f6d87657b445194a6d4"
Jul 10 20:35:03.682823 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.682628    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:03.683208 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:03.682699    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:03.683208 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:03.682913    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:35:03.683208 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:03.682950    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:35:04.020346 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.020265    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:35:04.021372 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.021298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" event={"ID":"6ec479f9-a54e-4141-a556-c0476391b7a3","Type":"ContainerStarted","Data":"26143964d98e4fcbf08cf38cb8fe9a2a88618eaa6536e49d0d95525bcc32ae5c"}
Jul 10 20:35:04.021519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.021392    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:35:04.021519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.021449    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:35:04.021727 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.021703    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:35:04.042246 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.042218    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:35:04.042505 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.042486    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:35:04.052754 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.051944    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p76js" podStartSLOduration=9.5790378 podStartE2EDuration="30.051923655s" totalImagesPullingTime="20.472885855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:04.050087431 +0000 UTC m=+29.890808186" watchObservedRunningTime="2026-07-10 20:35:04.051923655 +0000 UTC m=+29.892644407"
Jul 10 20:35:04.274019 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.273993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p55qj"]
Jul 10 20:35:04.274135 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.274122    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:04.274267 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:04.274248    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:35:04.281892 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.281869    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ff8xx"]
Jul 10 20:35:04.282006 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.281983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:04.282103 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:04.282084    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:35:04.282428 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.282408    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l478j"]
Jul 10 20:35:04.282511 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:04.282499    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:04.282600 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:04.282581    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:35:05.025354 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:05.025323    2571 generic.go:356] "Generic (PLEG): container finished" podID="7082368f-d1a2-4abb-8afe-5e2a09d5664a" containerID="603081c97f2367536645fd322349bb44c3e758a6e022a62a5d4fcf06ff0e5454" exitCode=0
Jul 10 20:35:05.025784 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:05.025406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerDied","Data":"603081c97f2367536645fd322349bb44c3e758a6e022a62a5d4fcf06ff0e5454"}
Jul 10 20:35:05.682749 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:05.682719    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:05.682749 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:05.682737    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:05.682930 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:05.682874    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:35:05.683019 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:05.682986    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:35:06.030423 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:06.030387    2571 generic.go:356] "Generic (PLEG): container finished" podID="7082368f-d1a2-4abb-8afe-5e2a09d5664a" containerID="fb3bb39d5884cc5c0d85bf5d8e677d62ac5d163b7fa3055dd75d1185d4273c40" exitCode=0
Jul 10 20:35:06.030936 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:06.030471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerDied","Data":"fb3bb39d5884cc5c0d85bf5d8e677d62ac5d163b7fa3055dd75d1185d4273c40"}
Jul 10 20:35:06.683047 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:06.682965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:06.683208 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:06.683083    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:35:07.427551 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:07.427519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:07.427571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:07.427589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427684    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427684    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427692    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427729    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:39.427715022 +0000 UTC m=+65.268435753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427741    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427751    2571 projected.go:196] Error preparing data for projected volume kube-api-access-x95fh for pod openshift-network-diagnostics/network-check-target-ff8xx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427742    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret podName:c380fc70-5a8a-4390-9e39-1b2113fd658b nodeName:}" failed. No retries permitted until 2026-07-10 20:35:39.427735695 +0000 UTC m=+65.268456425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret") pod "global-pull-secret-syncer-p55qj" (UID: "c380fc70-5a8a-4390-9e39-1b2113fd658b") : object "kube-system"/"original-pull-secret" not registered
Jul 10 20:35:07.427945 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.427794    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh podName:834b374c-6900-4807-bc23-5a8f69a9ca6c nodeName:}" failed. No retries permitted until 2026-07-10 20:35:39.427782093 +0000 UTC m=+65.268502824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x95fh" (UniqueName: "kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh") pod "network-check-target-ff8xx" (UID: "834b374c-6900-4807-bc23-5a8f69a9ca6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 20:35:07.682874 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:07.682789    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:07.682874 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:07.682834    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:07.683049 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.682910    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:35:07.683049 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:07.682975    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p55qj" podUID="c380fc70-5a8a-4390-9e39-1b2113fd658b"
Jul 10 20:35:08.683316 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:08.683283    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:08.683775 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:08.683389    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ff8xx" podUID="834b374c-6900-4807-bc23-5a8f69a9ca6c"
Jul 10 20:35:09.443819 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.443787    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-118.ec2.internal" event="NodeReady"
Jul 10 20:35:09.443990 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.443950    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 20:35:09.481321 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.481288    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2gbph"]
Jul 10 20:35:09.484014 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.483980    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:09.484315 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.484293    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fd9f58666-cw4tq"]
Jul 10 20:35:09.486093 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.486023    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.486543 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.486524    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 10 20:35:09.486676 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.486629    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cvp8c\""
Jul 10 20:35:09.486676 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.486635    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 10 20:35:09.488365 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.488343    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 20:35:09.488468 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.488385    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 20:35:09.488698 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.488681    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 20:35:09.488782 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.488681    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7k2jt\""
Jul 10 20:35:09.493781 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.493763    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 20:35:09.494406 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.494390    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2gbph"]
Jul 10 20:35:09.497132 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.497108    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hkclj"]
Jul 10 20:35:09.499673 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.499640    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.502447 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.502426    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 20:35:09.502574 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.502491    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hp552\""
Jul 10 20:35:09.502574 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.502534    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 20:35:09.503013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.502850    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 20:35:09.503897 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.503875    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-czgdv"]
Jul 10 20:35:09.505696 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.505677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd9f58666-cw4tq"]
Jul 10 20:35:09.505801 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.505746    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.507731 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.507566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkclj"]
Jul 10 20:35:09.508373 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.508243    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2m8z\""
Jul 10 20:35:09.508482 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.508421    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 20:35:09.508632 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.508615    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 20:35:09.516762 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.516735    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-czgdv"]
Jul 10 20:35:09.638382 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.638339    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xhzc2_5b550a91-8e4b-4702-a2b5-bddd4615eea9/konnectivity-agent/0.log" limit=1024
Jul 10 20:35:09.642163 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d826856-07ef-41ab-b45a-585fc71fa901-cert\") pod \"ingress-canary-hkclj\" (UID: \"4d826856-07ef-41ab-b45a-585fc71fa901\") " pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.642304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfb5d8ce-408f-4921-87fc-40ce61423eab-config-volume\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.642304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:09.642304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-image-registry-private-configuration\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb5d8ce-408f-4921-87fc-40ce61423eab-tmp-dir\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca030f0d-94e1-4644-9e42-60c0837150e8-ca-trust-extracted\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-bound-sa-token\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642412    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-certificates\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxpfq\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-kube-api-access-qxpfq\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnmg5\" (UniqueName: \"kubernetes.io/projected/4d826856-07ef-41ab-b45a-585fc71fa901-kube-api-access-pnmg5\") pod \"ingress-canary-hkclj\" (UID: \"4d826856-07ef-41ab-b45a-585fc71fa901\") " pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.642500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44e8013e-6cbf-41cd-b864-b6d3178cf783-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:09.642824 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.642824 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt877\" (UniqueName: \"kubernetes.io/projected/cfb5d8ce-408f-4921-87fc-40ce61423eab-kube-api-access-gt877\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.642824 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-installation-pull-secrets\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.642824 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.642698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-trusted-ca\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.683057 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.683028    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:09.683057 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.683038    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:09.685929 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.685896    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 20:35:09.686318 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.686083    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvkjn\""
Jul 10 20:35:09.686318 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.686095    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 20:35:09.720680 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.720555    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xhzc2_5b550a91-8e4b-4702-a2b5-bddd4615eea9/konnectivity-agent/0.log" limit=1024
Jul 10 20:35:09.743455 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d826856-07ef-41ab-b45a-585fc71fa901-cert\") pod \"ingress-canary-hkclj\" (UID: \"4d826856-07ef-41ab-b45a-585fc71fa901\") " pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfb5d8ce-408f-4921-87fc-40ce61423eab-config-volume\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743517    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-image-registry-private-configuration\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb5d8ce-408f-4921-87fc-40ce61423eab-tmp-dir\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.743573    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:09.743605 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.743591    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.743651    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:10.243630521 +0000 UTC m=+36.084351252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca030f0d-94e1-4644-9e42-60c0837150e8-ca-trust-extracted\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-bound-sa-token\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743790    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-certificates\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxpfq\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-kube-api-access-qxpfq\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnmg5\" (UniqueName: \"kubernetes.io/projected/4d826856-07ef-41ab-b45a-585fc71fa901-kube-api-access-pnmg5\") pod \"ingress-canary-hkclj\" (UID: \"4d826856-07ef-41ab-b45a-585fc71fa901\") " pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743870    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44e8013e-6cbf-41cd-b864-b6d3178cf783-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.743903    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.743971    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:09.744013 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.744006    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:35:10.243995557 +0000 UTC m=+36.084716287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744053    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb5d8ce-408f-4921-87fc-40ce61423eab-tmp-dir\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744127    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca030f0d-94e1-4644-9e42-60c0837150e8-ca-trust-extracted\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt877\" (UniqueName: \"kubernetes.io/projected/cfb5d8ce-408f-4921-87fc-40ce61423eab-kube-api-access-gt877\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.744156    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744195    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-installation-pull-secrets\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:09.744219    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:10.244200844 +0000 UTC m=+36.084921594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-trusted-ca\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.744519 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744301    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cfb5d8ce-408f-4921-87fc-40ce61423eab-config-volume\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.744951 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.744916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44e8013e-6cbf-41cd-b864-b6d3178cf783-nginx-conf\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:09.745196 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.745169    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-certificates\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.745395 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.745377    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-trusted-ca\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.748781 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.748633    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-image-registry-private-configuration\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.748869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.748743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-installation-pull-secrets\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.750027 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.750003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d826856-07ef-41ab-b45a-585fc71fa901-cert\") pod \"ingress-canary-hkclj\" (UID: \"4d826856-07ef-41ab-b45a-585fc71fa901\") " pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.752980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.752957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxpfq\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-kube-api-access-qxpfq\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.753138 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.753115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt877\" (UniqueName: \"kubernetes.io/projected/cfb5d8ce-408f-4921-87fc-40ce61423eab-kube-api-access-gt877\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:09.753428 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.753410    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnmg5\" (UniqueName: \"kubernetes.io/projected/4d826856-07ef-41ab-b45a-585fc71fa901-kube-api-access-pnmg5\") pod \"ingress-canary-hkclj\" (UID: \"4d826856-07ef-41ab-b45a-585fc71fa901\") " pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.753911 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.753887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-bound-sa-token\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:09.815603 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.815567    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkclj"
Jul 10 20:35:09.821471 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:09.821442    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xhzc2_5b550a91-8e4b-4702-a2b5-bddd4615eea9/konnectivity-agent/0.log" limit=1024
Jul 10 20:35:10.106904 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.106863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xhzc2_5b550a91-8e4b-4702-a2b5-bddd4615eea9/konnectivity-agent/0.log" limit=1024
Jul 10 20:35:10.208317 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.208279    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xhzc2_5b550a91-8e4b-4702-a2b5-bddd4615eea9/konnectivity-agent/0.log" limit=1024
Jul 10 20:35:10.247261 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.247223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:10.247448 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.247298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:10.247448 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.247338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:10.247448 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247381    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:10.247448 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247418    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:10.247448 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247437    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:10.247730 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247457    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:10.247730 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247444    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:35:11.247426115 +0000 UTC m=+37.088146865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:10.247730 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247541    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:11.247526088 +0000 UTC m=+37.088246822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:10.247730 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:10.247556    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:11.247546792 +0000 UTC m=+37.088267528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:10.656029 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.655895    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkclj"]
Jul 10 20:35:10.658592 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:35:10.658565    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d826856_07ef_41ab_b45a_585fc71fa901.slice/crio-fe518d23bb2e4f5b6d26b9d2cdb6fed940ccaa6621ec53307b3f9eab3792ac69 WatchSource:0}: Error finding container fe518d23bb2e4f5b6d26b9d2cdb6fed940ccaa6621ec53307b3f9eab3792ac69: Status 404 returned error can't find the container with id fe518d23bb2e4f5b6d26b9d2cdb6fed940ccaa6621ec53307b3f9eab3792ac69
Jul 10 20:35:10.685504 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.685485    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:10.688107 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.688084    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 20:35:10.689050 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.689030    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rhdms\""
Jul 10 20:35:10.689050 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:10.689042    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 20:35:11.043737 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:11.043643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkclj" event={"ID":"4d826856-07ef-41ab-b45a-585fc71fa901","Type":"ContainerStarted","Data":"fe518d23bb2e4f5b6d26b9d2cdb6fed940ccaa6621ec53307b3f9eab3792ac69"}
Jul 10 20:35:11.046257 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:11.046231    2571 generic.go:356] "Generic (PLEG): container finished" podID="7082368f-d1a2-4abb-8afe-5e2a09d5664a" containerID="fb9f01eaf79f690556bd0ee375456ad2f36b0febe490a8ddc41be4b03ba66641" exitCode=0
Jul 10 20:35:11.046395 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:11.046283    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerDied","Data":"fb9f01eaf79f690556bd0ee375456ad2f36b0febe490a8ddc41be4b03ba66641"}
Jul 10 20:35:11.255977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:11.255944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:11.256134 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:11.256010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:11.256134 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:11.256085    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:11.256134 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256127    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:11.256303 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256131    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:11.256303 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256166    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:11.256303 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256182    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:11.256303 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256192    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:35:13.256172701 +0000 UTC m=+39.096893450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:11.256303 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256210    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:13.256201687 +0000 UTC m=+39.096922416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:11.256303 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:11.256225    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:13.256217161 +0000 UTC m=+39.096937898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:12.052676 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:12.052630    2571 generic.go:356] "Generic (PLEG): container finished" podID="7082368f-d1a2-4abb-8afe-5e2a09d5664a" containerID="7e259bf830a562ebd68fee87dcb7092e9d0820af056a16e0eef4708fd2108caa" exitCode=0
Jul 10 20:35:12.053309 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:12.052702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerDied","Data":"7e259bf830a562ebd68fee87dcb7092e9d0820af056a16e0eef4708fd2108caa"}
Jul 10 20:35:13.059250 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:13.059005    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" event={"ID":"7082368f-d1a2-4abb-8afe-5e2a09d5664a","Type":"ContainerStarted","Data":"668f3caf1ef4fd5249461e59b59fa9dba130b2d97596af8d8b221f823000b3a3"}
Jul 10 20:35:13.084596 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:13.084533    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9pgtq" podStartSLOduration=6.873525798 podStartE2EDuration="38.084513615s" totalImagesPullingTime="31.210987817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:13.082267826 +0000 UTC m=+38.922988579" watchObservedRunningTime="2026-07-10 20:35:13.084513615 +0000 UTC m=+38.925234366"
Jul 10 20:35:13.272782 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:13.272740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:13.272967 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:13.272805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:13.272967 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:13.272867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:13.272967 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.272909    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:13.272967 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.272934    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:13.273183 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.272978    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:13.273183 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.273002    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:17.272980829 +0000 UTC m=+43.113701580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:13.273183 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.273013    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:13.273183 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.273062    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:35:17.273045293 +0000 UTC m=+43.113766037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:13.273183 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:13.273081    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:17.273071376 +0000 UTC m=+43.113792117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:14.063445 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:14.063416    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkclj" event={"ID":"4d826856-07ef-41ab-b45a-585fc71fa901","Type":"ContainerStarted","Data":"8d3feb73271f16c5bcd5e413f4f6fb867a1ca5bf4504ed30673dbd7047c6f164"}
Jul 10 20:35:14.078952 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:14.078907    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hkclj" podStartSLOduration=1.942004437 podStartE2EDuration="5.078893555s" totalImagesPullingTime="3.136889118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:14.077990424 +0000 UTC m=+39.918711177" watchObservedRunningTime="2026-07-10 20:35:14.078893555 +0000 UTC m=+39.919614308"
Jul 10 20:35:17.306355 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:17.306323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:17.306396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:17.306460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306488    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306553    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306592    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306612    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306564    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:25.306543927 +0000 UTC m=+51.147264671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:17.306677 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306681    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:35:25.306648345 +0000 UTC m=+51.147369075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:17.306924 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:17.306701    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:25.306691766 +0000 UTC m=+51.147412502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:25.369049 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:25.369009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:25.369070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:25.369097    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369178    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369217    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369231    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369183    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369259    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:35:41.369239209 +0000 UTC m=+67.209959946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369278    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:41.369268915 +0000 UTC m=+67.209989645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:25.369489 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:25.369294    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:35:41.369283496 +0000 UTC m=+67.210004227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:36.040713 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:36.040682    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p76js"
Jul 10 20:35:39.468761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.468723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:39.469141 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.468785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:39.469141 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.469105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:35:39.471981 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.471957    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 20:35:39.472116 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.472064    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 20:35:39.472116 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.472078    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 20:35:39.479564 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:39.479548    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 20:35:39.479693 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:39.479601    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:36:43.479585554 +0000 UTC m=+129.320306284 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : secret "metrics-daemon-secret" not found
Jul 10 20:35:39.482159 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.482139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c380fc70-5a8a-4390-9e39-1b2113fd658b-original-pull-secret\") pod \"global-pull-secret-syncer-p55qj\" (UID: \"c380fc70-5a8a-4390-9e39-1b2113fd658b\") " pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:39.484161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.484147    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 20:35:39.494709 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.494688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95fh\" (UniqueName: \"kubernetes.io/projected/834b374c-6900-4807-bc23-5a8f69a9ca6c-kube-api-access-x95fh\") pod \"network-check-target-ff8xx\" (UID: \"834b374c-6900-4807-bc23-5a8f69a9ca6c\") " pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:39.696848 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.696820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p55qj"
Jul 10 20:35:39.796460 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.796433    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rhdms\""
Jul 10 20:35:39.804439 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.804416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:39.812731 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.812705    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p55qj"]
Jul 10 20:35:39.816159 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:35:39.816124    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc380fc70_5a8a_4390_9e39_1b2113fd658b.slice/crio-c67572642a925589a1b5c5ff65ca66db4e16d5567399ba26f7071ba1265cdff0 WatchSource:0}: Error finding container c67572642a925589a1b5c5ff65ca66db4e16d5567399ba26f7071ba1265cdff0: Status 404 returned error can't find the container with id c67572642a925589a1b5c5ff65ca66db4e16d5567399ba26f7071ba1265cdff0
Jul 10 20:35:39.931045 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:39.931015    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ff8xx"]
Jul 10 20:35:39.934077 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:35:39.934052    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834b374c_6900_4807_bc23_5a8f69a9ca6c.slice/crio-e55b3b9e8412267c9f3eb9e97b8b6da44c71c790053e8605733c65d26f1b38aa WatchSource:0}: Error finding container e55b3b9e8412267c9f3eb9e97b8b6da44c71c790053e8605733c65d26f1b38aa: Status 404 returned error can't find the container with id e55b3b9e8412267c9f3eb9e97b8b6da44c71c790053e8605733c65d26f1b38aa
Jul 10 20:35:40.125481 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:40.125448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p55qj" event={"ID":"c380fc70-5a8a-4390-9e39-1b2113fd658b","Type":"ContainerStarted","Data":"c67572642a925589a1b5c5ff65ca66db4e16d5567399ba26f7071ba1265cdff0"}
Jul 10 20:35:40.126389 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:40.126369    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ff8xx" event={"ID":"834b374c-6900-4807-bc23-5a8f69a9ca6c","Type":"ContainerStarted","Data":"e55b3b9e8412267c9f3eb9e97b8b6da44c71c790053e8605733c65d26f1b38aa"}
Jul 10 20:35:41.385437 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:41.385399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:41.385452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:41.385485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385603    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385649    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:36:13.385637148 +0000 UTC m=+99.226357878 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385820    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385867    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:36:13.385853845 +0000 UTC m=+99.226574591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385875    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:35:41.385935 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385896    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:35:41.386367 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:35:41.385961    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:36:13.385941712 +0000 UTC m=+99.226662459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:35:43.136627 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:43.136586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ff8xx" event={"ID":"834b374c-6900-4807-bc23-5a8f69a9ca6c","Type":"ContainerStarted","Data":"f478822d1e9acec413efe0144fd24edb75e7fa45b021d597193a421c51eee2b0"}
Jul 10 20:35:43.137105 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:43.136702    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:35:43.153328 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:43.153272    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ff8xx" podStartSLOduration=66.134405401 podStartE2EDuration="1m9.153257309s" totalImagesPullingTime="3.018851908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:43.151843021 +0000 UTC m=+68.992563772" watchObservedRunningTime="2026-07-10 20:35:43.153257309 +0000 UTC m=+68.993978062"
Jul 10 20:35:45.142965 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:45.142923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p55qj" event={"ID":"c380fc70-5a8a-4390-9e39-1b2113fd658b","Type":"ContainerStarted","Data":"a3d4096dd667c2ec002088184eb7b967fd2f7025737592109e0821f7b900c6d8"}
Jul 10 20:35:45.157987 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:35:45.157945    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p55qj" podStartSLOduration=65.259677678 podStartE2EDuration="1m10.157932169s" totalImagesPullingTime="4.898254491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:45.156909008 +0000 UTC m=+70.997629761" watchObservedRunningTime="2026-07-10 20:35:45.157932169 +0000 UTC m=+70.998652920"
Jul 10 20:36:13.422118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:36:13.422069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:36:13.422118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:36:13.422139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:36:13.422186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422241    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422260    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422290    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422301    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422318    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:37:17.422301721 +0000 UTC m=+163.263022451 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422338    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:37:17.422325599 +0000 UTC m=+163.263046328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:36:13.422742 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:13.422352    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:37:17.422346108 +0000 UTC m=+163.263066837 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:36:14.142200 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:36:14.142122    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ff8xx"
Jul 10 20:36:43.533848 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:36:43.533812    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:36:43.534231 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:43.533959    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 20:36:43.534231 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:36:43.534036    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:45.534016542 +0000 UTC m=+251.374737278 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : secret "metrics-daemon-secret" not found
Jul 10 20:37:12.497991 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:12.497928    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph" podUID="44e8013e-6cbf-41cd-b864-b6d3178cf783"
Jul 10 20:37:12.506453 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:12.506431    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8"
Jul 10 20:37:12.523668 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:12.523632    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-czgdv" podUID="cfb5d8ce-408f-4921-87fc-40ce61423eab"
Jul 10 20:37:12.701230 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:12.701192    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:37:13.342993 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:13.342959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:37:13.343179 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:13.342960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czgdv"
Jul 10 20:37:13.343179 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:13.342960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:37:17.474736 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:17.474654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474772    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:17.474781    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:17.474822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474843    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls podName:cfb5d8ce-408f-4921-87fc-40ce61423eab nodeName:}" failed. No retries permitted until 2026-07-10 20:39:19.474823083 +0000 UTC m=+285.315543828 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls") pod "dns-default-czgdv" (UID: "cfb5d8ce-408f-4921-87fc-40ce61423eab") : secret "dns-default-metrics-tls" not found
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474886    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474918    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474938    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert podName:44e8013e-6cbf-41cd-b864-b6d3178cf783 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:19.474925316 +0000 UTC m=+285.315646048 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-2gbph" (UID: "44e8013e-6cbf-41cd-b864-b6d3178cf783") : secret "networking-console-plugin-cert" not found
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474939    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5fd9f58666-cw4tq: secret "image-registry-tls" not found
Jul 10 20:37:17.475136 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:37:17.474988    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls podName:ca030f0d-94e1-4644-9e42-60c0837150e8 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:19.474974877 +0000 UTC m=+285.315695607 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls") pod "image-registry-5fd9f58666-cw4tq" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8") : secret "image-registry-tls" not found
Jul 10 20:37:26.683036 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:37:26.682943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:38:44.865473 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.865441    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rm2bj"]
Jul 10 20:38:44.867275 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.867258    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.868933 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.868912    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"]
Jul 10 20:38:44.869706 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.869685    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 20:38:44.869847 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.869828    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ds8dh\""
Jul 10 20:38:44.869927 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.869834    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 10 20:38:44.869927 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.869875    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 20:38:44.870027 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.869962    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 10 20:38:44.870704 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.870687    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"]
Jul 10 20:38:44.870826 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.870809    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:44.872679 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.872644    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:44.874639 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.874621    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-22p46\""
Jul 10 20:38:44.875046 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.875025    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 10 20:38:44.875571 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.875373    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 10 20:38:44.875953 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.875930    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 10 20:38:44.876035 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.875961    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 10 20:38:44.877738 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.877724    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:38:44.879980 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.879963    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 10 20:38:44.881130 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.881106    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9rp6t\""
Jul 10 20:38:44.881216 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.881197    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:38:44.883842 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.883824    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 10 20:38:44.892345 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.892322    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rm2bj"]
Jul 10 20:38:44.893099 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.893076    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"]
Jul 10 20:38:44.893711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.893691    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"]
Jul 10 20:38:44.962670 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.962629    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"]
Jul 10 20:38:44.964690 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.964676    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"
Jul 10 20:38:44.966929 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.966908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c7af49-a396-45b5-8d31-e73add77a445-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.967049 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.966943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0c7af49-a396-45b5-8d31-e73add77a445-snapshots\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.967049 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.966975    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c7af49-a396-45b5-8d31-e73add77a445-tmp\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.967049 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.966993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c7af49-a396-45b5-8d31-e73add77a445-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.967230 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.967063    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:38:44.967230 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.967080    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzj9\" (UniqueName: \"kubernetes.io/projected/e0c7af49-a396-45b5-8d31-e73add77a445-kube-api-access-fgzj9\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.967230 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.967137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c7af49-a396-45b5-8d31-e73add77a445-serving-cert\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:44.967230 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.967180    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 20:38:44.967230 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.967180    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xwd9m\""
Jul 10 20:38:44.969201 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.969178    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"]
Jul 10 20:38:44.971118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.971100    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"]
Jul 10 20:38:44.971233 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.971219    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"
Jul 10 20:38:44.973263 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.973242    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:44.973991 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.973976    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fvlnd\""
Jul 10 20:38:44.974466 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.974446    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"]
Jul 10 20:38:44.976305 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.976288    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 10 20:38:44.976381 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.976290    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:38:44.976820 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.976759    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 10 20:38:44.977060 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.977046    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 10 20:38:44.977231 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.977213    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-74n4q\""
Jul 10 20:38:44.987108 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.987087    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"]
Jul 10 20:38:44.987931 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:44.987913    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"]
Jul 10 20:38:45.068055 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzj9\" (UniqueName: \"kubernetes.io/projected/e0c7af49-a396-45b5-8d31-e73add77a445-kube-api-access-fgzj9\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068219 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068074    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqdfq\" (UniqueName: \"kubernetes.io/projected/92aa9b82-f235-42a1-894e-748920a3d3c6-kube-api-access-wqdfq\") pod \"volume-data-source-validator-78495597f6-xsvk2\" (UID: \"92aa9b82-f235-42a1-894e-748920a3d3c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"
Jul 10 20:38:45.068219 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068095    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0c7af49-a396-45b5-8d31-e73add77a445-snapshots\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068219 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rv9c\" (UniqueName: \"kubernetes.io/projected/03659ba7-1a78-412a-92b0-157e06a38ceb-kube-api-access-7rv9c\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.068219 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03659ba7-1a78-412a-92b0-157e06a38ceb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.068219 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068171    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c7af49-a396-45b5-8d31-e73add77a445-tmp\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068219 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c7af49-a396-45b5-8d31-e73add77a445-serving-cert\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068510 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgf2\" (UniqueName: \"kubernetes.io/projected/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-kube-api-access-5wgf2\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:45.068510 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c7af49-a396-45b5-8d31-e73add77a445-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068510 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03659ba7-1a78-412a-92b0-157e06a38ceb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.068684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068553    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:45.068684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068647    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c7af49-a396-45b5-8d31-e73add77a445-tmp\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c7af49-a396-45b5-8d31-e73add77a445-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068809 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068699    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e0c7af49-a396-45b5-8d31-e73add77a445-snapshots\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.068941 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.068921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c7af49-a396-45b5-8d31-e73add77a445-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.069311 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.069294    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0c7af49-a396-45b5-8d31-e73add77a445-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.070529 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.070513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e0c7af49-a396-45b5-8d31-e73add77a445-serving-cert\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.075860 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.075841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzj9\" (UniqueName: \"kubernetes.io/projected/e0c7af49-a396-45b5-8d31-e73add77a445-kube-api-access-fgzj9\") pod \"insights-operator-68d9dd94cf-rm2bj\" (UID: \"e0c7af49-a396-45b5-8d31-e73add77a445\") " pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.169993 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.169927    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9vk2\" (UniqueName: \"kubernetes.io/projected/0127dff1-2d13-44b3-9079-aa07b6f179db-kube-api-access-l9vk2\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.169993 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.169984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqdfq\" (UniqueName: \"kubernetes.io/projected/92aa9b82-f235-42a1-894e-748920a3d3c6-kube-api-access-wqdfq\") pod \"volume-data-source-validator-78495597f6-xsvk2\" (UID: \"92aa9b82-f235-42a1-894e-748920a3d3c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"
Jul 10 20:38:45.170128 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170011    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0127dff1-2d13-44b3-9079-aa07b6f179db-config\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.170128 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rv9c\" (UniqueName: \"kubernetes.io/projected/03659ba7-1a78-412a-92b0-157e06a38ceb-kube-api-access-7rv9c\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.170128 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03659ba7-1a78-412a-92b0-157e06a38ceb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.170231 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170129    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0127dff1-2d13-44b3-9079-aa07b6f179db-serving-cert\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.170231 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk84d\" (UniqueName: \"kubernetes.io/projected/e2bcb495-25d8-4a62-90b3-ee9675cade07-kube-api-access-tk84d\") pod \"network-check-source-869dcfcdcd-zl86g\" (UID: \"e2bcb495-25d8-4a62-90b3-ee9675cade07\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"
Jul 10 20:38:45.170231 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgf2\" (UniqueName: \"kubernetes.io/projected/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-kube-api-access-5wgf2\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:45.170353 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03659ba7-1a78-412a-92b0-157e06a38ceb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.170353 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:45.170475 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:45.170458    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 20:38:45.170531 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:45.170509    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls podName:3818699a-009e-4fea-9eb6-ffdfd3fd0e59 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:45.670495943 +0000 UTC m=+251.511216673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-mhk4q" (UID: "3818699a-009e-4fea-9eb6-ffdfd3fd0e59") : secret "samples-operator-tls" not found
Jul 10 20:38:45.170594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.170565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03659ba7-1a78-412a-92b0-157e06a38ceb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.172411 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.172389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03659ba7-1a78-412a-92b0-157e06a38ceb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.177585 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.177561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj"
Jul 10 20:38:45.178118 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.178101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rv9c\" (UniqueName: \"kubernetes.io/projected/03659ba7-1a78-412a-92b0-157e06a38ceb-kube-api-access-7rv9c\") pod \"kube-storage-version-migrator-operator-799cb7f958-tm69t\" (UID: \"03659ba7-1a78-412a-92b0-157e06a38ceb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.178485 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.178467    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgf2\" (UniqueName: \"kubernetes.io/projected/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-kube-api-access-5wgf2\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:45.178738 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.178718    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqdfq\" (UniqueName: \"kubernetes.io/projected/92aa9b82-f235-42a1-894e-748920a3d3c6-kube-api-access-wqdfq\") pod \"volume-data-source-validator-78495597f6-xsvk2\" (UID: \"92aa9b82-f235-42a1-894e-748920a3d3c6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"
Jul 10 20:38:45.186375 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.186357    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"
Jul 10 20:38:45.271206 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.271173    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9vk2\" (UniqueName: \"kubernetes.io/projected/0127dff1-2d13-44b3-9079-aa07b6f179db-kube-api-access-l9vk2\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.271334 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.271322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0127dff1-2d13-44b3-9079-aa07b6f179db-config\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.271421 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.271406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0127dff1-2d13-44b3-9079-aa07b6f179db-serving-cert\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.271507 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.271436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk84d\" (UniqueName: \"kubernetes.io/projected/e2bcb495-25d8-4a62-90b3-ee9675cade07-kube-api-access-tk84d\") pod \"network-check-source-869dcfcdcd-zl86g\" (UID: \"e2bcb495-25d8-4a62-90b3-ee9675cade07\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"
Jul 10 20:38:45.271938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.271916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0127dff1-2d13-44b3-9079-aa07b6f179db-config\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.274040 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.273958    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0127dff1-2d13-44b3-9079-aa07b6f179db-serving-cert\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.274124 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.274062    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"
Jul 10 20:38:45.280047 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.280004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9vk2\" (UniqueName: \"kubernetes.io/projected/0127dff1-2d13-44b3-9079-aa07b6f179db-kube-api-access-l9vk2\") pod \"service-ca-operator-7695fc6c8c-g7h95\" (UID: \"0127dff1-2d13-44b3-9079-aa07b6f179db\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.281040 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.281013    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk84d\" (UniqueName: \"kubernetes.io/projected/e2bcb495-25d8-4a62-90b3-ee9675cade07-kube-api-access-tk84d\") pod \"network-check-source-869dcfcdcd-zl86g\" (UID: \"e2bcb495-25d8-4a62-90b3-ee9675cade07\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"
Jul 10 20:38:45.282506 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.282486    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"
Jul 10 20:38:45.287129 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.287107    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"
Jul 10 20:38:45.306951 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.306615    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rm2bj"]
Jul 10 20:38:45.309326 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:38:45.309289    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c7af49_a396_45b5_8d31_e73add77a445.slice/crio-070894e518da6532837205881887af52faa6eee78792512b1c14f8bab6f53c15 WatchSource:0}: Error finding container 070894e518da6532837205881887af52faa6eee78792512b1c14f8bab6f53c15: Status 404 returned error can't find the container with id 070894e518da6532837205881887af52faa6eee78792512b1c14f8bab6f53c15
Jul 10 20:38:45.329551 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.329473    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t"]
Jul 10 20:38:45.418498 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.418435    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2"]
Jul 10 20:38:45.422677 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:38:45.422636    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92aa9b82_f235_42a1_894e_748920a3d3c6.slice/crio-f6f39e588a6a3debc6f716d97fe34a496ee18414655b1ae5f4c72cef2e5725a3 WatchSource:0}: Error finding container f6f39e588a6a3debc6f716d97fe34a496ee18414655b1ae5f4c72cef2e5725a3: Status 404 returned error can't find the container with id f6f39e588a6a3debc6f716d97fe34a496ee18414655b1ae5f4c72cef2e5725a3
Jul 10 20:38:45.562348 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.562310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj" event={"ID":"e0c7af49-a396-45b5-8d31-e73add77a445","Type":"ContainerStarted","Data":"070894e518da6532837205881887af52faa6eee78792512b1c14f8bab6f53c15"}
Jul 10 20:38:45.563387 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.563361    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2" event={"ID":"92aa9b82-f235-42a1-894e-748920a3d3c6","Type":"ContainerStarted","Data":"f6f39e588a6a3debc6f716d97fe34a496ee18414655b1ae5f4c72cef2e5725a3"}
Jul 10 20:38:45.564298 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.564279    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t" event={"ID":"03659ba7-1a78-412a-92b0-157e06a38ceb","Type":"ContainerStarted","Data":"f4367d5a6410f6f0fd3881bb6260446523fb0a3b246f984e5c8c672081d78bdb"}
Jul 10 20:38:45.573724 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.573697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:38:45.573825 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:45.573811    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 20:38:45.573873 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:45.573862    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs podName:3b5e65ae-4b6d-448f-b752-4a0535d4e586 nodeName:}" failed. No retries permitted until 2026-07-10 20:40:47.57384852 +0000 UTC m=+373.414569250 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs") pod "network-metrics-daemon-l478j" (UID: "3b5e65ae-4b6d-448f-b752-4a0535d4e586") : secret "metrics-daemon-secret" not found
Jul 10 20:38:45.645974 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.645943    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95"]
Jul 10 20:38:45.647497 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.647471    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g"]
Jul 10 20:38:45.649339 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:38:45.649312    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0127dff1_2d13_44b3_9079_aa07b6f179db.slice/crio-5488f0d4d63f7f985c3febdc73e98a13fae4ee9a124f794be10cb3c5b1bc9e16 WatchSource:0}: Error finding container 5488f0d4d63f7f985c3febdc73e98a13fae4ee9a124f794be10cb3c5b1bc9e16: Status 404 returned error can't find the container with id 5488f0d4d63f7f985c3febdc73e98a13fae4ee9a124f794be10cb3c5b1bc9e16
Jul 10 20:38:45.650160 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:38:45.650138    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2bcb495_25d8_4a62_90b3_ee9675cade07.slice/crio-a660538397fbcb93dd056a17fdd3a5706a62291b393d8a5b2abb15ce2bc1855f WatchSource:0}: Error finding container a660538397fbcb93dd056a17fdd3a5706a62291b393d8a5b2abb15ce2bc1855f: Status 404 returned error can't find the container with id a660538397fbcb93dd056a17fdd3a5706a62291b393d8a5b2abb15ce2bc1855f
Jul 10 20:38:45.674075 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:45.674019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:45.674172 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:45.674134    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 20:38:45.674264 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:45.674202    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls podName:3818699a-009e-4fea-9eb6-ffdfd3fd0e59 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:46.674182183 +0000 UTC m=+252.514902938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-mhk4q" (UID: "3818699a-009e-4fea-9eb6-ffdfd3fd0e59") : secret "samples-operator-tls" not found
Jul 10 20:38:46.571741 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:46.571044    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g" event={"ID":"e2bcb495-25d8-4a62-90b3-ee9675cade07","Type":"ContainerStarted","Data":"99e9e3c7c573c8f2e9a5c8966365bdaabb8ae17ebbc987ffa4c4c3a6dfa67002"}
Jul 10 20:38:46.571741 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:46.571104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g" event={"ID":"e2bcb495-25d8-4a62-90b3-ee9675cade07","Type":"ContainerStarted","Data":"a660538397fbcb93dd056a17fdd3a5706a62291b393d8a5b2abb15ce2bc1855f"}
Jul 10 20:38:46.575434 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:46.575369    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95" event={"ID":"0127dff1-2d13-44b3-9079-aa07b6f179db","Type":"ContainerStarted","Data":"5488f0d4d63f7f985c3febdc73e98a13fae4ee9a124f794be10cb3c5b1bc9e16"}
Jul 10 20:38:46.595677 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:46.592118    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-zl86g" podStartSLOduration=2.592098792 podStartE2EDuration="2.592098792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:46.586347791 +0000 UTC m=+252.427068538" watchObservedRunningTime="2026-07-10 20:38:46.592098792 +0000 UTC m=+252.432819534"
Jul 10 20:38:46.681764 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:46.681718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:46.681961 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:46.681939    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 20:38:46.682067 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:46.682051    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls podName:3818699a-009e-4fea-9eb6-ffdfd3fd0e59 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:48.682030272 +0000 UTC m=+254.522751018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-mhk4q" (UID: "3818699a-009e-4fea-9eb6-ffdfd3fd0e59") : secret "samples-operator-tls" not found
Jul 10 20:38:47.581467 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:47.581428    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2" event={"ID":"92aa9b82-f235-42a1-894e-748920a3d3c6","Type":"ContainerStarted","Data":"0d63b9261053549a5f759946def60d7b8df4a5167776ae4d329bdb568bb6155b"}
Jul 10 20:38:47.596863 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:47.596808    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-xsvk2" podStartSLOduration=2.507283172 podStartE2EDuration="3.596787788s" totalImagesPullingTime="1.089504616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:47.596518015 +0000 UTC m=+253.437238770" watchObservedRunningTime="2026-07-10 20:38:47.596787788 +0000 UTC m=+253.437508543"
Jul 10 20:38:48.700454 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:48.699999    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:48.700454 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:48.700171    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 20:38:48.700454 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:48.700235    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls podName:3818699a-009e-4fea-9eb6-ffdfd3fd0e59 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:52.700215221 +0000 UTC m=+258.540935952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-mhk4q" (UID: "3818699a-009e-4fea-9eb6-ffdfd3fd0e59") : secret "samples-operator-tls" not found
Jul 10 20:38:49.327077 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.327043    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mqzlb"]
Jul 10 20:38:49.329532 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.329516    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.333390 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.333351    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 20:38:49.333503 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.333357    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n7x97\""
Jul 10 20:38:49.333503 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.333448    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 20:38:49.347928 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.347905    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqzlb"]
Jul 10 20:38:49.405431 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.405405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-crio-socket\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.405588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.405451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjfd\" (UniqueName: \"kubernetes.io/projected/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-api-access-5vjfd\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.405588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.405473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-data-volume\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.405588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.405539    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.405588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.405558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506246 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-data-volume\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506437 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506296    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506437 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506327    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506437 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-crio-socket\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506437 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:49.506416    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 20:38:49.506649 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjfd\" (UniqueName: \"kubernetes.io/projected/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-api-access-5vjfd\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506649 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:49.506496    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:50.006476865 +0000 UTC m=+255.847197668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : configmap "kube-rbac-proxy" not found
Jul 10 20:38:49.506649 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:49.506515    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:49.506649 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-crio-socket\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.506649 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:49.506554    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:50.006542847 +0000 UTC m=+255.847263584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:49.506649 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.506581    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-data-volume\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.517298 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.517276    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjfd\" (UniqueName: \"kubernetes.io/projected/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-api-access-5vjfd\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:49.589515 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.589431    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t" event={"ID":"03659ba7-1a78-412a-92b0-157e06a38ceb","Type":"ContainerStarted","Data":"049675c4b5d56ac69a4343f500e10d463a5d5bf4a275c19077df1a47a193ea92"}
Jul 10 20:38:49.590934 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.590911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95" event={"ID":"0127dff1-2d13-44b3-9079-aa07b6f179db","Type":"ContainerStarted","Data":"98766312c8c43339efb8976dc176ef1fee69fdab7860e487c8310abe4fe32231"}
Jul 10 20:38:49.592281 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.592255    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj" event={"ID":"e0c7af49-a396-45b5-8d31-e73add77a445","Type":"ContainerStarted","Data":"7484129fa1f55beba83410795d33d1cb142b4e6b5089939ff30d8211fe0a0043"}
Jul 10 20:38:49.605078 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.605026    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t" podStartSLOduration=2.354092024 podStartE2EDuration="5.605009218s" totalImagesPullingTime="3.250917194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:49.60483032 +0000 UTC m=+255.445551071" watchObservedRunningTime="2026-07-10 20:38:49.605009218 +0000 UTC m=+255.445729972"
Jul 10 20:38:49.619505 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.619465    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95" podStartSLOduration=2.679019728 podStartE2EDuration="5.619451748s" totalImagesPullingTime="2.94043202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:49.618685256 +0000 UTC m=+255.459406006" watchObservedRunningTime="2026-07-10 20:38:49.619451748 +0000 UTC m=+255.460172499"
Jul 10 20:38:49.637401 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:49.637360    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj" podStartSLOduration=2.364465522 podStartE2EDuration="5.637344513s" totalImagesPullingTime="3.272878991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:49.636814112 +0000 UTC m=+255.477534866" watchObservedRunningTime="2026-07-10 20:38:49.637344513 +0000 UTC m=+255.478065267"
Jul 10 20:38:50.010809 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.010726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:50.010809 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.010766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:50.011215 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:50.010841    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 20:38:50.011215 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:50.010915    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:51.010896759 +0000 UTC m=+256.851617490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : configmap "kube-rbac-proxy" not found
Jul 10 20:38:50.011215 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:50.010954    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:50.011215 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:50.011026    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:51.011009646 +0000 UTC m=+256.851730393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:50.622516 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.622487    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"]
Jul 10 20:38:50.624733 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.624717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"
Jul 10 20:38:50.627228 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.627207    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 10 20:38:50.627443 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.627424    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 10 20:38:50.628182 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.628162    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bw7rc\""
Jul 10 20:38:50.635404 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.635371    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"]
Jul 10 20:38:50.719038 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.719013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrdn\" (UniqueName: \"kubernetes.io/projected/2d8f99fd-c63c-4ba5-9ea4-b44ca3605253-kube-api-access-fmrdn\") pod \"migrator-7f59b54f6c-l6ls5\" (UID: \"2d8f99fd-c63c-4ba5-9ea4-b44ca3605253\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"
Jul 10 20:38:50.819975 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.819940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrdn\" (UniqueName: \"kubernetes.io/projected/2d8f99fd-c63c-4ba5-9ea4-b44ca3605253-kube-api-access-fmrdn\") pod \"migrator-7f59b54f6c-l6ls5\" (UID: \"2d8f99fd-c63c-4ba5-9ea4-b44ca3605253\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"
Jul 10 20:38:50.828160 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.828129    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrdn\" (UniqueName: \"kubernetes.io/projected/2d8f99fd-c63c-4ba5-9ea4-b44ca3605253-kube-api-access-fmrdn\") pod \"migrator-7f59b54f6c-l6ls5\" (UID: \"2d8f99fd-c63c-4ba5-9ea4-b44ca3605253\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"
Jul 10 20:38:50.934722 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:50.934630    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"
Jul 10 20:38:51.021154 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.021121    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:51.021154 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.021174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:51.021154 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:51.021276    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 20:38:51.021927 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:51.021351    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:53.02133133 +0000 UTC m=+258.862052066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : configmap "kube-rbac-proxy" not found
Jul 10 20:38:51.021927 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:51.021378    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:51.021927 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:51.021436    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:53.021419789 +0000 UTC m=+258.862140525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:51.057260 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.057210    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5"]
Jul 10 20:38:51.059438 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:38:51.059414    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8f99fd_c63c_4ba5_9ea4_b44ca3605253.slice/crio-590fe414981c52aa545aa5205e931db9d8207e12316da183d514bfd0c3e1c0af WatchSource:0}: Error finding container 590fe414981c52aa545aa5205e931db9d8207e12316da183d514bfd0c3e1c0af: Status 404 returned error can't find the container with id 590fe414981c52aa545aa5205e931db9d8207e12316da183d514bfd0c3e1c0af
Jul 10 20:38:51.507092 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.507060    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nzd67_0bff3f7e-55ab-4915-8ea8-6148ac876e50/dns-node-resolver/0.log"
Jul 10 20:38:51.600015 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.599980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5" event={"ID":"2d8f99fd-c63c-4ba5-9ea4-b44ca3605253","Type":"ContainerStarted","Data":"590fe414981c52aa545aa5205e931db9d8207e12316da183d514bfd0c3e1c0af"}
Jul 10 20:38:51.981999 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.981966    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tt8cf"]
Jul 10 20:38:51.984014 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.983998    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:51.986718 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.986697    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 10 20:38:51.987828 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.987811    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8xj4j\""
Jul 10 20:38:51.987929 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.987811    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 10 20:38:51.987929 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.987836    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 10 20:38:51.987929 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.987853    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 10 20:38:51.993869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:51.993850    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tt8cf"]
Jul 10 20:38:52.030392 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.030361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c203b87-74e5-4f4f-8e79-df0341f72495-signing-key\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.030392 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.030397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcd79\" (UniqueName: \"kubernetes.io/projected/1c203b87-74e5-4f4f-8e79-df0341f72495-kube-api-access-kcd79\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.030837 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.030440    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c203b87-74e5-4f4f-8e79-df0341f72495-signing-cabundle\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.107515 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.107485    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq8zn_98aac43a-543e-4b20-8795-82794a28b7a9/node-ca/0.log"
Jul 10 20:38:52.131003 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.130968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c203b87-74e5-4f4f-8e79-df0341f72495-signing-key\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.131003 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.131007    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcd79\" (UniqueName: \"kubernetes.io/projected/1c203b87-74e5-4f4f-8e79-df0341f72495-kube-api-access-kcd79\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.131191 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.131053    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c203b87-74e5-4f4f-8e79-df0341f72495-signing-cabundle\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.131818 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.131794    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1c203b87-74e5-4f4f-8e79-df0341f72495-signing-cabundle\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.133455 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.133439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1c203b87-74e5-4f4f-8e79-df0341f72495-signing-key\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.139422 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.139396    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcd79\" (UniqueName: \"kubernetes.io/projected/1c203b87-74e5-4f4f-8e79-df0341f72495-kube-api-access-kcd79\") pod \"service-ca-79f68b9f4f-tt8cf\" (UID: \"1c203b87-74e5-4f4f-8e79-df0341f72495\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.293801 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.293715    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf"
Jul 10 20:38:52.528689 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.528651    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tt8cf"]
Jul 10 20:38:52.532036 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:38:52.532013    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c203b87_74e5_4f4f_8e79_df0341f72495.slice/crio-6f5d22c3f4dd61916e30eb92006d4230f1edbf19b8d394a74ad5df0df498b460 WatchSource:0}: Error finding container 6f5d22c3f4dd61916e30eb92006d4230f1edbf19b8d394a74ad5df0df498b460: Status 404 returned error can't find the container with id 6f5d22c3f4dd61916e30eb92006d4230f1edbf19b8d394a74ad5df0df498b460
Jul 10 20:38:52.605435 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.605402    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5" event={"ID":"2d8f99fd-c63c-4ba5-9ea4-b44ca3605253","Type":"ContainerStarted","Data":"cc9d2dbc4b0e983662a9f59ccdef07e063f4781c5c895e2631711b69d5bc54c1"}
Jul 10 20:38:52.605581 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.605461    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5" event={"ID":"2d8f99fd-c63c-4ba5-9ea4-b44ca3605253","Type":"ContainerStarted","Data":"61fef021f252b56c4b122aa542f1550ba4dc040eb0c119e327a6df159b533ca9"}
Jul 10 20:38:52.607153 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.607125    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf" event={"ID":"1c203b87-74e5-4f4f-8e79-df0341f72495","Type":"ContainerStarted","Data":"ab76ef0d7869a062182595c0f079ed87c52a38fd62daddde25bb66baec99572b"}
Jul 10 20:38:52.607276 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.607179    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf" event={"ID":"1c203b87-74e5-4f4f-8e79-df0341f72495","Type":"ContainerStarted","Data":"6f5d22c3f4dd61916e30eb92006d4230f1edbf19b8d394a74ad5df0df498b460"}
Jul 10 20:38:52.621619 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.621573    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-l6ls5" podStartSLOduration=1.258230761 podStartE2EDuration="2.62155838s" totalImagesPullingTime="1.363327619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:52.620622695 +0000 UTC m=+258.461343451" watchObservedRunningTime="2026-07-10 20:38:52.62155838 +0000 UTC m=+258.462279133"
Jul 10 20:38:52.637445 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.637394    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-tt8cf" podStartSLOduration=1.6373770319999998 podStartE2EDuration="1.637377032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:38:52.637309418 +0000 UTC m=+258.478030189" watchObservedRunningTime="2026-07-10 20:38:52.637377032 +0000 UTC m=+258.478097787"
Jul 10 20:38:52.737402 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:52.737369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:38:52.737561 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:52.737540    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 10 20:38:52.737632 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:52.737621    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls podName:3818699a-009e-4fea-9eb6-ffdfd3fd0e59 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:00.737601113 +0000 UTC m=+266.578321848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls") pod "cluster-samples-operator-65db858894-mhk4q" (UID: "3818699a-009e-4fea-9eb6-ffdfd3fd0e59") : secret "samples-operator-tls" not found
Jul 10 20:38:53.040833 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:53.040746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:53.040833 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:53.040785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:53.041243 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:53.040890    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 20:38:53.041243 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:53.040971    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:57.040948824 +0000 UTC m=+262.881669567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : configmap "kube-rbac-proxy" not found
Jul 10 20:38:53.041243 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:53.040898    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:53.041243 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:53.041023    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:38:57.041011503 +0000 UTC m=+262.881732233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:53.107799 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:53.107767    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkclj_4d826856-07ef-41ab-b45a-585fc71fa901/serve-healthcheck-canary/0.log"
Jul 10 20:38:57.074488 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:57.074396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:57.074488 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:38:57.074443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:38:57.074906 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:57.074525    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 20:38:57.074906 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:57.074586    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:05.074570519 +0000 UTC m=+270.915291266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : configmap "kube-rbac-proxy" not found
Jul 10 20:38:57.074906 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:57.074620    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 20:38:57.074906 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:38:57.074702    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls podName:649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:05.074688801 +0000 UTC m=+270.915409531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mqzlb" (UID: "649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70") : secret "insights-runtime-extractor-tls" not found
Jul 10 20:39:00.809062 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:00.809018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:39:00.811596 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:00.811570    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3818699a-009e-4fea-9eb6-ffdfd3fd0e59-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mhk4q\" (UID: \"3818699a-009e-4fea-9eb6-ffdfd3fd0e59\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:39:01.090789 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:01.090689    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"
Jul 10 20:39:01.216462 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:01.216437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q"]
Jul 10 20:39:01.637785 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:01.637747    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q" event={"ID":"3818699a-009e-4fea-9eb6-ffdfd3fd0e59","Type":"ContainerStarted","Data":"7e4553cb715c7d41c270d07deecd020f4ab8cb419152861367fae048df603702"}
Jul 10 20:39:03.647438 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:03.647360    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q" event={"ID":"3818699a-009e-4fea-9eb6-ffdfd3fd0e59","Type":"ContainerStarted","Data":"9337f30a966d3e8cf000a520990ba92b4ffa30f7406673cd0cafb978cd3f9181"}
Jul 10 20:39:03.647438 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:03.647409    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q" event={"ID":"3818699a-009e-4fea-9eb6-ffdfd3fd0e59","Type":"ContainerStarted","Data":"629f03341fafdc23d0696f54bb08d4674bd28a20d11c4bfab7d793a55a2cd7e3"}
Jul 10 20:39:03.663819 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:03.663776    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mhk4q" podStartSLOduration=17.599262462 podStartE2EDuration="19.663762153s" totalImagesPullingTime="2.064499691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:03.663179255 +0000 UTC m=+269.503900006" watchObservedRunningTime="2026-07-10 20:39:03.663762153 +0000 UTC m=+269.504482906"
Jul 10 20:39:05.141738 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.141703    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:39:05.142135 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.141746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:39:05.142246 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.142224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:39:05.144072 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.144054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqzlb\" (UID: \"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70\") " pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:39:05.239228 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.239187    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqzlb"
Jul 10 20:39:05.385920 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.385894    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqzlb"]
Jul 10 20:39:05.388827 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:05.388804    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649b1ada_abd0_49f6_ad3d_b8cfa1ddfb70.slice/crio-a8af35fe443e945d05e8ab7f7dc3cdd1626043092e0c082c01b509093e895d24 WatchSource:0}: Error finding container a8af35fe443e945d05e8ab7f7dc3cdd1626043092e0c082c01b509093e895d24: Status 404 returned error can't find the container with id a8af35fe443e945d05e8ab7f7dc3cdd1626043092e0c082c01b509093e895d24
Jul 10 20:39:05.655009 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:05.654932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqzlb" event={"ID":"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70","Type":"ContainerStarted","Data":"a8af35fe443e945d05e8ab7f7dc3cdd1626043092e0c082c01b509093e895d24"}
Jul 10 20:39:09.671173 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:09.671140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqzlb" event={"ID":"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70","Type":"ContainerStarted","Data":"993ac03d14ab1b2c7c41ae3f5c4280da6d10bcc6fae7ea99691ae2b39a37f100"}
Jul 10 20:39:10.677444 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:10.677405    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqzlb" event={"ID":"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70","Type":"ContainerStarted","Data":"821cdc5f83de8c09a387b4c6edfdafe5dd1ca2c044cb5fd2eecfe37645859c94"}
Jul 10 20:39:11.774130 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.774066    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-44txl"]
Jul 10 20:39:11.781381 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.781354    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:11.784387 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.784236    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 20:39:11.784387 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.784236    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rgkj2\""
Jul 10 20:39:11.784387 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.784241    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 20:39:11.790360 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.790151    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-44txl"]
Jul 10 20:39:11.902018 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:11.901983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7cgp\" (UniqueName: \"kubernetes.io/projected/18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc-kube-api-access-b7cgp\") pod \"downloads-68c9cbb497-44txl\" (UID: \"18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc\") " pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:12.003356 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.003310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7cgp\" (UniqueName: \"kubernetes.io/projected/18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc-kube-api-access-b7cgp\") pod \"downloads-68c9cbb497-44txl\" (UID: \"18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc\") " pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:12.011488 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.011462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7cgp\" (UniqueName: \"kubernetes.io/projected/18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc-kube-api-access-b7cgp\") pod \"downloads-68c9cbb497-44txl\" (UID: \"18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc\") " pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:12.093347 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.093300    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:12.584989 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.584965    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-44txl"]
Jul 10 20:39:12.587808 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:12.587786    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18092ccd_0fd5_4a5f_9627_7cb3ac3a6cdc.slice/crio-05aed2d96910c1fa948d9b86189b9efd3feb34fe3f24c134a8edf40cca158c24 WatchSource:0}: Error finding container 05aed2d96910c1fa948d9b86189b9efd3feb34fe3f24c134a8edf40cca158c24: Status 404 returned error can't find the container with id 05aed2d96910c1fa948d9b86189b9efd3feb34fe3f24c134a8edf40cca158c24
Jul 10 20:39:12.686781 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.686745    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqzlb" event={"ID":"649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70","Type":"ContainerStarted","Data":"e6f647f258ec02d673285806720a03d694b6ac1697974dc59a5a1fb5533d5c89"}
Jul 10 20:39:12.687404 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.687383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-44txl" event={"ID":"18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc","Type":"ContainerStarted","Data":"05aed2d96910c1fa948d9b86189b9efd3feb34fe3f24c134a8edf40cca158c24"}
Jul 10 20:39:12.705359 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:12.705308    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mqzlb" podStartSLOduration=16.716088114 podStartE2EDuration="23.705292507s" totalImagesPullingTime="6.989204393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:38:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:12.703864404 +0000 UTC m=+278.544585157" watchObservedRunningTime="2026-07-10 20:39:12.705292507 +0000 UTC m=+278.546013259"
Jul 10 20:39:16.344245 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:16.344185    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph" podUID="44e8013e-6cbf-41cd-b864-b6d3178cf783"
Jul 10 20:39:16.344245 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:16.344195    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8"
Jul 10 20:39:16.344708 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:16.344185    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-czgdv" podUID="cfb5d8ce-408f-4921-87fc-40ce61423eab"
Jul 10 20:39:16.702894 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:16.702816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:39:16.702894 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:16.702875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:16.703091 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:16.703000    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czgdv"
Jul 10 20:39:19.568930 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.568895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:39:19.569331 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.568952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:19.569331 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.568981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:39:19.571917 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.571885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb5d8ce-408f-4921-87fc-40ce61423eab-metrics-tls\") pod \"dns-default-czgdv\" (UID: \"cfb5d8ce-408f-4921-87fc-40ce61423eab\") " pod="openshift-dns/dns-default-czgdv"
Jul 10 20:39:19.572050 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.571992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/44e8013e-6cbf-41cd-b864-b6d3178cf783-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-2gbph\" (UID: \"44e8013e-6cbf-41cd-b864-b6d3178cf783\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:39:19.572156 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.572076    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"image-registry-5fd9f58666-cw4tq\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") " pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:19.706818 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.706784    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cvp8c\""
Jul 10 20:39:19.706818 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.706804    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j2m8z\""
Jul 10 20:39:19.706818 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.706804    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7k2jt\""
Jul 10 20:39:19.718160 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.713530    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph"
Jul 10 20:39:19.718160 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.714104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czgdv"
Jul 10 20:39:19.718160 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.714763    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:19.887296 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.887265    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-2gbph"]
Jul 10 20:39:19.891396 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:19.891364    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e8013e_6cbf_41cd_b864_b6d3178cf783.slice/crio-0a774c017fe8ddf74b35502adf85ad9ae371f18fe285dc145562deb2a199e063 WatchSource:0}: Error finding container 0a774c017fe8ddf74b35502adf85ad9ae371f18fe285dc145562deb2a199e063: Status 404 returned error can't find the container with id 0a774c017fe8ddf74b35502adf85ad9ae371f18fe285dc145562deb2a199e063
Jul 10 20:39:19.921427 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.921400    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fd9f58666-cw4tq"]
Jul 10 20:39:19.924164 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:19.924138    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca030f0d_94e1_4644_9e42_60c0837150e8.slice/crio-0dfdd235dfc2da9f8f1fd09c554b4ba59276e5be2120a1e6311a153c6bc024b2 WatchSource:0}: Error finding container 0dfdd235dfc2da9f8f1fd09c554b4ba59276e5be2120a1e6311a153c6bc024b2: Status 404 returned error can't find the container with id 0dfdd235dfc2da9f8f1fd09c554b4ba59276e5be2120a1e6311a153c6bc024b2
Jul 10 20:39:19.938540 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:19.938516    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-czgdv"]
Jul 10 20:39:19.941364 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:19.941337    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb5d8ce_408f_4921_87fc_40ce61423eab.slice/crio-5cc25dfec20ef9a08a2e197eb99a3998f2bf40e064aaa2ca233b7ff589a51112 WatchSource:0}: Error finding container 5cc25dfec20ef9a08a2e197eb99a3998f2bf40e064aaa2ca233b7ff589a51112: Status 404 returned error can't find the container with id 5cc25dfec20ef9a08a2e197eb99a3998f2bf40e064aaa2ca233b7ff589a51112
Jul 10 20:39:20.722703 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:20.722650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" event={"ID":"ca030f0d-94e1-4644-9e42-60c0837150e8","Type":"ContainerStarted","Data":"03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419"}
Jul 10 20:39:20.723158 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:20.722728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" event={"ID":"ca030f0d-94e1-4644-9e42-60c0837150e8","Type":"ContainerStarted","Data":"0dfdd235dfc2da9f8f1fd09c554b4ba59276e5be2120a1e6311a153c6bc024b2"}
Jul 10 20:39:20.723508 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:20.723483    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:20.724967 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:20.724904    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph" event={"ID":"44e8013e-6cbf-41cd-b864-b6d3178cf783","Type":"ContainerStarted","Data":"0a774c017fe8ddf74b35502adf85ad9ae371f18fe285dc145562deb2a199e063"}
Jul 10 20:39:20.726598 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:20.726564    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czgdv" event={"ID":"cfb5d8ce-408f-4921-87fc-40ce61423eab","Type":"ContainerStarted","Data":"5cc25dfec20ef9a08a2e197eb99a3998f2bf40e064aaa2ca233b7ff589a51112"}
Jul 10 20:39:20.748105 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:20.748056    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" podStartSLOduration=285.748041087 podStartE2EDuration="4m45.748041087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:20.746005282 +0000 UTC m=+286.586726050" watchObservedRunningTime="2026-07-10 20:39:20.748041087 +0000 UTC m=+286.588761818"
Jul 10 20:39:22.735543 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:22.735450    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph" event={"ID":"44e8013e-6cbf-41cd-b864-b6d3178cf783","Type":"ContainerStarted","Data":"9683b9188dca0fe5d882720c2c397d80bdea97f7405fa2141e630f9b03ea90b9"}
Jul 10 20:39:22.737160 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:22.737133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czgdv" event={"ID":"cfb5d8ce-408f-4921-87fc-40ce61423eab","Type":"ContainerStarted","Data":"2f8161f7ec978ca5c18aa2864b2c251f6d716863b036c27f6e96afc5123935a2"}
Jul 10 20:39:22.737304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:22.737175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czgdv" event={"ID":"cfb5d8ce-408f-4921-87fc-40ce61423eab","Type":"ContainerStarted","Data":"8997081d31e7bc23aecd1aa9b19b25f0f2e4b584a2cad93c40c62eeb863ca2bf"}
Jul 10 20:39:22.737362 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:22.737325    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-czgdv"
Jul 10 20:39:22.750104 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:22.750049    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-2gbph" podStartSLOduration=272.441060393 podStartE2EDuration="4m34.750031073s" totalImagesPullingTime="2.30897068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:22.749960399 +0000 UTC m=+288.590681154" watchObservedRunningTime="2026-07-10 20:39:22.750031073 +0000 UTC m=+288.590751825"
Jul 10 20:39:22.765264 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:22.765217    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-czgdv" podStartSLOduration=251.499774663 podStartE2EDuration="4m13.765203603s" totalImagesPullingTime="2.26542894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:22.764798439 +0000 UTC m=+288.605519194" watchObservedRunningTime="2026-07-10 20:39:22.765203603 +0000 UTC m=+288.605924354"
Jul 10 20:39:24.733419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.733385    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-tb8s8"]
Jul 10 20:39:24.736323 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.736299    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:24.738726 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.738648    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 20:39:24.739869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.739813    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 20:39:24.740060 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.740042    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 20:39:24.740138 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.740126    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 20:39:24.740200 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.740124    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mf7hr\""
Jul 10 20:39:24.740200 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.740159    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 20:39:24.746010 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.745987    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-tb8s8"]
Jul 10 20:39:24.916506 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.916468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bvnt\" (UniqueName: \"kubernetes.io/projected/981b1651-4183-4c44-b0b9-29b8b526b07f-kube-api-access-8bvnt\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:24.916670 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.916524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/981b1651-4183-4c44-b0b9-29b8b526b07f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:24.916670 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.916591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:24.916787 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:24.916721    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.018028 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.017931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.018028 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.018001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.018028 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.018029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bvnt\" (UniqueName: \"kubernetes.io/projected/981b1651-4183-4c44-b0b9-29b8b526b07f-kube-api-access-8bvnt\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.018304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.018063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/981b1651-4183-4c44-b0b9-29b8b526b07f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.018304 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:25.018127    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 10 20:39:25.018304 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:25.018198    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-tls podName:981b1651-4183-4c44-b0b9-29b8b526b07f nodeName:}" failed. No retries permitted until 2026-07-10 20:39:25.518178136 +0000 UTC m=+291.358898867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-tls") pod "prometheus-operator-64785b6675-tb8s8" (UID: "981b1651-4183-4c44-b0b9-29b8b526b07f") : secret "prometheus-operator-tls" not found
Jul 10 20:39:25.018821 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.018800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/981b1651-4183-4c44-b0b9-29b8b526b07f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.020810 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.020787    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.027565 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.027538    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bvnt\" (UniqueName: \"kubernetes.io/projected/981b1651-4183-4c44-b0b9-29b8b526b07f-kube-api-access-8bvnt\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.521398 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.521354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.523973 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.523944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/981b1651-4183-4c44-b0b9-29b8b526b07f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-tb8s8\" (UID: \"981b1651-4183-4c44-b0b9-29b8b526b07f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:25.647675 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:25.647629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8"
Jul 10 20:39:26.925880 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.925844    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f79fd4b55-vnq8b"]
Jul 10 20:39:26.928692 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.928650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:26.931050 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.931024    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 20:39:26.931158 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.931095    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 20:39:26.932232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.932105    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 20:39:26.932232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.932133    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 20:39:26.932418 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.932365    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hnc4g\""
Jul 10 20:39:26.932418 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.932372    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 20:39:26.936806 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.936784    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 20:39:26.937936 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:26.937885    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f79fd4b55-vnq8b"]
Jul 10 20:39:27.033573 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033539    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjc6d\" (UniqueName: \"kubernetes.io/projected/c948f30a-485d-4236-b86b-831a0166088c-kube-api-access-qjc6d\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.033773 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-trusted-ca-bundle\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.033773 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033637    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-serving-cert\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.033773 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-oauth-serving-cert\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.033938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-console-config\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.033938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-service-ca\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.033938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.033896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-oauth-config\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134581 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-trusted-ca-bundle\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134593    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-serving-cert\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-oauth-serving-cert\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-console-config\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134761 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-service-ca\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134966 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-oauth-config\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.134966 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.134815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjc6d\" (UniqueName: \"kubernetes.io/projected/c948f30a-485d-4236-b86b-831a0166088c-kube-api-access-qjc6d\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.135576 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.135526    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-oauth-serving-cert\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.135576 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.135570    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-console-config\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.135864 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.135598    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-trusted-ca-bundle\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.135864 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.135624    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-service-ca\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.137397 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.137371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-serving-cert\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.137601 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.137580    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-oauth-config\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.142229 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.142202    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjc6d\" (UniqueName: \"kubernetes.io/projected/c948f30a-485d-4236-b86b-831a0166088c-kube-api-access-qjc6d\") pod \"console-5f79fd4b55-vnq8b\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") " pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:27.241318 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:27.241235    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:29.684015 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:29.683940    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l478j" podUID="3b5e65ae-4b6d-448f-b752-4a0535d4e586"
Jul 10 20:39:29.765566 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:29.765535    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-tb8s8"]
Jul 10 20:39:29.770808 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:29.770779    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981b1651_4183_4c44_b0b9_29b8b526b07f.slice/crio-8ec379a490e2dc6f10dab0364c8469870e0ec2e075f42999893da18d35be8248 WatchSource:0}: Error finding container 8ec379a490e2dc6f10dab0364c8469870e0ec2e075f42999893da18d35be8248: Status 404 returned error can't find the container with id 8ec379a490e2dc6f10dab0364c8469870e0ec2e075f42999893da18d35be8248
Jul 10 20:39:29.786232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:29.786208    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f79fd4b55-vnq8b"]
Jul 10 20:39:29.789105 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:29.789082    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc948f30a_485d_4236_b86b_831a0166088c.slice/crio-9af0a50342ad2685b1e8b93dcbd64ce6f50e656a78a49dc78de59bb60385c7a4 WatchSource:0}: Error finding container 9af0a50342ad2685b1e8b93dcbd64ce6f50e656a78a49dc78de59bb60385c7a4: Status 404 returned error can't find the container with id 9af0a50342ad2685b1e8b93dcbd64ce6f50e656a78a49dc78de59bb60385c7a4
Jul 10 20:39:30.774691 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:30.774168    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-44txl" event={"ID":"18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc","Type":"ContainerStarted","Data":"2d30eb99960b574eb9de20e5defc25c6598c3e9c7daf56f9495a4474d1209522"}
Jul 10 20:39:30.775215 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:30.775189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:30.778222 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:30.778161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8" event={"ID":"981b1651-4183-4c44-b0b9-29b8b526b07f","Type":"ContainerStarted","Data":"8ec379a490e2dc6f10dab0364c8469870e0ec2e075f42999893da18d35be8248"}
Jul 10 20:39:30.779757 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:30.779727    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f79fd4b55-vnq8b" event={"ID":"c948f30a-485d-4236-b86b-831a0166088c","Type":"ContainerStarted","Data":"9af0a50342ad2685b1e8b93dcbd64ce6f50e656a78a49dc78de59bb60385c7a4"}
Jul 10 20:39:30.793163 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:30.792987    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-44txl"
Jul 10 20:39:30.810481 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:30.810422    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-44txl" podStartSLOduration=2.66350339 podStartE2EDuration="19.810400852s" totalImagesPullingTime="17.146897462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:30.792031083 +0000 UTC m=+296.632751836" watchObservedRunningTime="2026-07-10 20:39:30.810400852 +0000 UTC m=+296.651121607"
Jul 10 20:39:32.746062 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:32.746021    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-czgdv"
Jul 10 20:39:32.791130 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:32.791098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8" event={"ID":"981b1651-4183-4c44-b0b9-29b8b526b07f","Type":"ContainerStarted","Data":"be6b03f3a418772cf650922fee5c6f19b44eeaac619c9f7eeb28d56baa3a71c6"}
Jul 10 20:39:33.797915 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:33.797879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8" event={"ID":"981b1651-4183-4c44-b0b9-29b8b526b07f","Type":"ContainerStarted","Data":"b828f782be2bdbe6b6cef74a8ff1a1e48b880b26fa201a60c21637f7f4213f8e"}
Jul 10 20:39:33.800492 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:33.799989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f79fd4b55-vnq8b" event={"ID":"c948f30a-485d-4236-b86b-831a0166088c","Type":"ContainerStarted","Data":"f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4"}
Jul 10 20:39:33.815419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:33.815365    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-tb8s8" podStartSLOduration=7.727198451 podStartE2EDuration="9.815349828s" totalImagesPullingTime="2.088151377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:33.813075069 +0000 UTC m=+299.653795822" watchObservedRunningTime="2026-07-10 20:39:33.815349828 +0000 UTC m=+299.656070580"
Jul 10 20:39:33.835643 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:33.834565    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f79fd4b55-vnq8b" podStartSLOduration=3.970566825 podStartE2EDuration="7.834541703s" totalImagesPullingTime="3.863974878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:33.829563388 +0000 UTC m=+299.670284138" watchObservedRunningTime="2026-07-10 20:39:33.834541703 +0000 UTC m=+299.675262456"
Jul 10 20:39:34.547741 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:34.547708    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd9f58666-cw4tq"]
Jul 10 20:39:34.553862 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:34.553746    2571 patch_prober.go:28] interesting pod/image-registry-5fd9f58666-cw4tq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 20:39:34.553862 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:34.553802    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 20:39:34.590330 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:34.590302    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:39:34.590644 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:34.590625    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:39:34.594936 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:34.594916    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 20:39:36.101551 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.101502    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mlvsk"]
Jul 10 20:39:36.160082 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.160053    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.164918 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.164892    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-99dbm\""
Jul 10 20:39:36.165173 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.165156    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 20:39:36.165447 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.165429    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 20:39:36.165685 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.165646    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 20:39:36.215112 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbn6\" (UniqueName: \"kubernetes.io/projected/08658ea6-4a7f-4685-bfaf-1c29bae430b9-kube-api-access-gfbn6\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215132    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-wtmp\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-root\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-textfile\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08658ea6-4a7f-4685-bfaf-1c29bae430b9-metrics-client-ca\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215279    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-sys\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215600 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.215600 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.215385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.316811    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.316872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.316907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbn6\" (UniqueName: \"kubernetes.io/projected/08658ea6-4a7f-4685-bfaf-1c29bae430b9-kube-api-access-gfbn6\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.316941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-wtmp\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.316966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-root\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.316995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-textfile\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.317023    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08658ea6-4a7f-4685-bfaf-1c29bae430b9-metrics-client-ca\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.317050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.317078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-sys\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.317177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-sys\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.317948 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.317784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.318634 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.318223    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-root\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.318767 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.318649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-wtmp\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.321691 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.319147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08658ea6-4a7f-4685-bfaf-1c29bae430b9-metrics-client-ca\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.321691 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.319375    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-textfile\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.321691 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:36.319460    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 20:39:36.321691 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:36.319541    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls podName:08658ea6-4a7f-4685-bfaf-1c29bae430b9 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:36.819523113 +0000 UTC m=+302.660243851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls") pod "node-exporter-mlvsk" (UID: "08658ea6-4a7f-4685-bfaf-1c29bae430b9") : secret "node-exporter-tls" not found
Jul 10 20:39:36.334835 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.334808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.335209 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.335184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbn6\" (UniqueName: \"kubernetes.io/projected/08658ea6-4a7f-4685-bfaf-1c29bae430b9-kube-api-access-gfbn6\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.821718 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:36.821679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:36.821922 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:36.821860    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 20:39:36.821997 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:36.821965    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls podName:08658ea6-4a7f-4685-bfaf-1c29bae430b9 nodeName:}" failed. No retries permitted until 2026-07-10 20:39:37.821945689 +0000 UTC m=+303.662666419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls") pod "node-exporter-mlvsk" (UID: "08658ea6-4a7f-4685-bfaf-1c29bae430b9") : secret "node-exporter-tls" not found
Jul 10 20:39:37.241445 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.241354    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:37.241445 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.241433    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:37.247324 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.247284    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:37.823392 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.823352    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:39:37.832638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.832604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:37.835346 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.835315    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08658ea6-4a7f-4685-bfaf-1c29bae430b9-node-exporter-tls\") pod \"node-exporter-mlvsk\" (UID: \"08658ea6-4a7f-4685-bfaf-1c29bae430b9\") " pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:37.976288 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:37.976247    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mlvsk"
Jul 10 20:39:38.022322 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:38.022285    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08658ea6_4a7f_4685_bfaf_1c29bae430b9.slice/crio-01bf0cb136982f116382f869a7801751b55f5a16b49f6c4d174cd9d70bdb09b1 WatchSource:0}: Error finding container 01bf0cb136982f116382f869a7801751b55f5a16b49f6c4d174cd9d70bdb09b1: Status 404 returned error can't find the container with id 01bf0cb136982f116382f869a7801751b55f5a16b49f6c4d174cd9d70bdb09b1
Jul 10 20:39:38.024355 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:38.024332    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 20:39:38.825000 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:38.824954    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlvsk" event={"ID":"08658ea6-4a7f-4685-bfaf-1c29bae430b9","Type":"ContainerStarted","Data":"01bf0cb136982f116382f869a7801751b55f5a16b49f6c4d174cd9d70bdb09b1"}
Jul 10 20:39:39.829967 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:39.829936    2571 generic.go:356] "Generic (PLEG): container finished" podID="08658ea6-4a7f-4685-bfaf-1c29bae430b9" containerID="1cc249fcf155cc7f68e4389a53fbfd21e0b58c2eeaf7fb354525baeff7101ac8" exitCode=0
Jul 10 20:39:39.830321 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:39.830028    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlvsk" event={"ID":"08658ea6-4a7f-4685-bfaf-1c29bae430b9","Type":"ContainerDied","Data":"1cc249fcf155cc7f68e4389a53fbfd21e0b58c2eeaf7fb354525baeff7101ac8"}
Jul 10 20:39:40.837493 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:40.837456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlvsk" event={"ID":"08658ea6-4a7f-4685-bfaf-1c29bae430b9","Type":"ContainerStarted","Data":"d7674f39770fe5ec8b61e33b5cebbfe9668cbd2f42ebe40fc772c9200c890eb7"}
Jul 10 20:39:40.837968 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:40.837517    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mlvsk" event={"ID":"08658ea6-4a7f-4685-bfaf-1c29bae430b9","Type":"ContainerStarted","Data":"e290e6ff7f1d02c815fbdcc6c03b6a88ac7e937494c8503e71994764cedc1694"}
Jul 10 20:39:40.862952 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:40.862890    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mlvsk" podStartSLOduration=3.288575286 podStartE2EDuration="4.862871504s" totalImagesPullingTime="1.491988481s" totalInitContainerRuntime="82.307737ms" isStatefulPod=true podCreationTimestamp="2026-07-10 20:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:40.861093885 +0000 UTC m=+306.701814642" watchObservedRunningTime="2026-07-10 20:39:40.862871504 +0000 UTC m=+306.703592260"
Jul 10 20:39:41.942891 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:41.942857    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85fbdd77b7-5pn2v"]
Jul 10 20:39:41.991850 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:41.991809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fbdd77b7-5pn2v"]
Jul 10 20:39:41.991850 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:41.991843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075063 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075019    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-trusted-ca-bundle\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075117    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-config\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-serving-cert\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ggfl\" (UniqueName: \"kubernetes.io/projected/933877c4-2adc-45c7-b4a6-d3167c4dab5a-kube-api-access-8ggfl\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075341 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075272    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-oauth-config\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075341 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-oauth-serving-cert\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.075405 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.075341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-service-ca\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176576 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-oauth-config\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176766 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176594    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-oauth-serving-cert\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176766 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-service-ca\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176766 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176693    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-trusted-ca-bundle\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176766 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-config\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176766 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-serving-cert\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.176950 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.176779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ggfl\" (UniqueName: \"kubernetes.io/projected/933877c4-2adc-45c7-b4a6-d3167c4dab5a-kube-api-access-8ggfl\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.177541 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.177514    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-service-ca\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.177696 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.177513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-config\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.177696 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.177585    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-oauth-serving-cert\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.178127 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.178104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-trusted-ca-bundle\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.179801 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.179769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-oauth-config\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.179801 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.179780    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-serving-cert\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.184859 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.184841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ggfl\" (UniqueName: \"kubernetes.io/projected/933877c4-2adc-45c7-b4a6-d3167c4dab5a-kube-api-access-8ggfl\") pod \"console-85fbdd77b7-5pn2v\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") " pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.300361 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.300322    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:42.483209 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.483186    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85fbdd77b7-5pn2v"]
Jul 10 20:39:42.485677 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:39:42.485626    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933877c4_2adc_45c7_b4a6_d3167c4dab5a.slice/crio-8f3fa44f400a7104edbab4dfd3e030411d27bef51c4546f862b1316283e1f2fb WatchSource:0}: Error finding container 8f3fa44f400a7104edbab4dfd3e030411d27bef51c4546f862b1316283e1f2fb: Status 404 returned error can't find the container with id 8f3fa44f400a7104edbab4dfd3e030411d27bef51c4546f862b1316283e1f2fb
Jul 10 20:39:42.846543 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.846446    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbdd77b7-5pn2v" event={"ID":"933877c4-2adc-45c7-b4a6-d3167c4dab5a","Type":"ContainerStarted","Data":"d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795"}
Jul 10 20:39:42.846543 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.846511    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbdd77b7-5pn2v" event={"ID":"933877c4-2adc-45c7-b4a6-d3167c4dab5a","Type":"ContainerStarted","Data":"8f3fa44f400a7104edbab4dfd3e030411d27bef51c4546f862b1316283e1f2fb"}
Jul 10 20:39:42.863778 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:42.863723    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85fbdd77b7-5pn2v" podStartSLOduration=1.863709873 podStartE2EDuration="1.863709873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:39:42.863249556 +0000 UTC m=+308.703970309" watchObservedRunningTime="2026-07-10 20:39:42.863709873 +0000 UTC m=+308.704430625"
Jul 10 20:39:43.683675 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:43.683636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:39:44.552460 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:44.552431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:52.301156 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:52.301121    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:52.301721 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:52.301365    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:52.308820 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:52.308793    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:52.888229 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:52.888200    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:39:52.936912 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:52.936881    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f79fd4b55-vnq8b"]
Jul 10 20:39:54.892847 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:54.892810    2571 generic.go:356] "Generic (PLEG): container finished" podID="e0c7af49-a396-45b5-8d31-e73add77a445" containerID="7484129fa1f55beba83410795d33d1cb142b4e6b5089939ff30d8211fe0a0043" exitCode=0
Jul 10 20:39:54.893235 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:54.892896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj" event={"ID":"e0c7af49-a396-45b5-8d31-e73add77a445","Type":"ContainerDied","Data":"7484129fa1f55beba83410795d33d1cb142b4e6b5089939ff30d8211fe0a0043"}
Jul 10 20:39:54.893282 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:54.893256    2571 scope.go:117] "RemoveContainer" containerID="7484129fa1f55beba83410795d33d1cb142b4e6b5089939ff30d8211fe0a0043"
Jul 10 20:39:55.488748 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:55.488711    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-mhk4q_3818699a-009e-4fea-9eb6-ffdfd3fd0e59/cluster-samples-operator/0.log"
Jul 10 20:39:55.494235 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:55.494205    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-65db858894-mhk4q_3818699a-009e-4fea-9eb6-ffdfd3fd0e59/cluster-samples-operator-watch/0.log"
Jul 10 20:39:55.898703 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:55.898646    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rm2bj" event={"ID":"e0c7af49-a396-45b5-8d31-e73add77a445","Type":"ContainerStarted","Data":"1b210603a82f4fee7fe1d7d33fcecffd72f646e28d8d392d62cb16f27c1b7cbb"}
Jul 10 20:39:59.576556 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.576492    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8" containerName="registry" containerID="cri-o://03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419" gracePeriod=30
Jul 10 20:39:59.811327 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.811296    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:59.917680 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.917634    2571 generic.go:356] "Generic (PLEG): container finished" podID="03659ba7-1a78-412a-92b0-157e06a38ceb" containerID="049675c4b5d56ac69a4343f500e10d463a5d5bf4a275c19077df1a47a193ea92" exitCode=0
Jul 10 20:39:59.917788 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.917689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t" event={"ID":"03659ba7-1a78-412a-92b0-157e06a38ceb","Type":"ContainerDied","Data":"049675c4b5d56ac69a4343f500e10d463a5d5bf4a275c19077df1a47a193ea92"}
Jul 10 20:39:59.918076 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.918056    2571 scope.go:117] "RemoveContainer" containerID="049675c4b5d56ac69a4343f500e10d463a5d5bf4a275c19077df1a47a193ea92"
Jul 10 20:39:59.918952 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.918931    2571 generic.go:356] "Generic (PLEG): container finished" podID="ca030f0d-94e1-4644-9e42-60c0837150e8" containerID="03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419" exitCode=0
Jul 10 20:39:59.919043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.918972    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq"
Jul 10 20:39:59.919043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.919006    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" event={"ID":"ca030f0d-94e1-4644-9e42-60c0837150e8","Type":"ContainerDied","Data":"03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419"}
Jul 10 20:39:59.919117 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.919065    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fd9f58666-cw4tq" event={"ID":"ca030f0d-94e1-4644-9e42-60c0837150e8","Type":"ContainerDied","Data":"0dfdd235dfc2da9f8f1fd09c554b4ba59276e5be2120a1e6311a153c6bc024b2"}
Jul 10 20:39:59.919117 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.919086    2571 scope.go:117] "RemoveContainer" containerID="03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419"
Jul 10 20:39:59.927899 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.927881    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-installation-pull-secrets\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.927954 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.927915    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-bound-sa-token\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.927954 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.927938    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca030f0d-94e1-4644-9e42-60c0837150e8-ca-trust-extracted\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.928046 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.927962    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.928046 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.928026    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-certificates\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.928142 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.928066    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-image-registry-private-configuration\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.928142 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.928097    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxpfq\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-kube-api-access-qxpfq\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.928245 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.928152    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-trusted-ca\") pod \"ca030f0d-94e1-4644-9e42-60c0837150e8\" (UID: \"ca030f0d-94e1-4644-9e42-60c0837150e8\") "
Jul 10 20:39:59.928773 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.928736    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:39:59.928907 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.928779    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:39:59.930782 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.930754    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:39:59.930878 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.930781    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:39:59.930940 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.930900    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-kube-api-access-qxpfq" (OuterVolumeSpecName: "kube-api-access-qxpfq") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "kube-api-access-qxpfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:39:59.931157 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.931131    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:39:59.936798 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.936774    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca030f0d-94e1-4644-9e42-60c0837150e8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:39:59.939032 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.939009    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ca030f0d-94e1-4644-9e42-60c0837150e8" (UID: "ca030f0d-94e1-4644-9e42-60c0837150e8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:39:59.965840 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.965817    2571 scope.go:117] "RemoveContainer" containerID="03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419"
Jul 10 20:39:59.966200 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:39:59.966171    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419\": container with ID starting with 03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419 not found: ID does not exist" containerID="03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419"
Jul 10 20:39:59.966262 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:39:59.966212    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419"} err="failed to get container status \"03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419\": rpc error: code = NotFound desc = could not find container \"03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419\": container with ID starting with 03bdd53cb8c11ddbbc16c0c723bfc253de51d94472b8376dfc132713d3147419 not found: ID does not exist"
Jul 10 20:40:00.029811 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029781    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-image-registry-private-configuration\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029811 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029812    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxpfq\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-kube-api-access-qxpfq\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029829    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-trusted-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029842    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca030f0d-94e1-4644-9e42-60c0837150e8-installation-pull-secrets\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029858    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-bound-sa-token\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029871    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca030f0d-94e1-4644-9e42-60c0837150e8-ca-trust-extracted\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029886    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-tls\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.029996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.029899    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca030f0d-94e1-4644-9e42-60c0837150e8-registry-certificates\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:00.240473 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.240447    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5fd9f58666-cw4tq"]
Jul 10 20:40:00.244646 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.244616    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5fd9f58666-cw4tq"]
Jul 10 20:40:00.687738 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.687703    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8" path="/var/lib/kubelet/pods/ca030f0d-94e1-4644-9e42-60c0837150e8/volumes"
Jul 10 20:40:00.925195 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:00.925162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tm69t" event={"ID":"03659ba7-1a78-412a-92b0-157e06a38ceb","Type":"ContainerStarted","Data":"64fec7070111cca29911f82ac7c2ed4e412ba94294cb5591924780b10b1e6e66"}
Jul 10 20:40:17.957523 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:17.957456    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f79fd4b55-vnq8b" podUID="c948f30a-485d-4236-b86b-831a0166088c" containerName="console" containerID="cri-o://f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4" gracePeriod=15
Jul 10 20:40:18.224472 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.224402    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:40:18.382629 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382595    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-oauth-config\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.382629 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382636    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-trusted-ca-bundle\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.382872 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382697    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjc6d\" (UniqueName: \"kubernetes.io/projected/c948f30a-485d-4236-b86b-831a0166088c-kube-api-access-qjc6d\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.382872 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382795    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-console-config\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.382872 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382847    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-serving-cert\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.383022 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382910    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-oauth-serving-cert\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.383022 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.382937    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-service-ca\") pod \"c948f30a-485d-4236-b86b-831a0166088c\" (UID: \"c948f30a-485d-4236-b86b-831a0166088c\") "
Jul 10 20:40:18.383210 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.383175    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:40:18.383287 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.383234    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-console-config" (OuterVolumeSpecName: "console-config") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:40:18.383452 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.383302    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:40:18.383517 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.383485    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-service-ca" (OuterVolumeSpecName: "service-ca") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:40:18.385029 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.385004    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c948f30a-485d-4236-b86b-831a0166088c-kube-api-access-qjc6d" (OuterVolumeSpecName: "kube-api-access-qjc6d") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "kube-api-access-qjc6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:40:18.385106 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.385027    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:40:18.385106 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.385063    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c948f30a-485d-4236-b86b-831a0166088c" (UID: "c948f30a-485d-4236-b86b-831a0166088c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483581    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483614    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483623    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483634    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483642    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjc6d\" (UniqueName: \"kubernetes.io/projected/c948f30a-485d-4236-b86b-831a0166088c-kube-api-access-qjc6d\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483651    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c948f30a-485d-4236-b86b-831a0166088c-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.483686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.483680    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c948f30a-485d-4236-b86b-831a0166088c-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:40:18.999186 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.999156    2571 generic.go:356] "Generic (PLEG): container finished" podID="c948f30a-485d-4236-b86b-831a0166088c" containerID="f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4" exitCode=0
Jul 10 20:40:18.999654 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.999200    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f79fd4b55-vnq8b"
Jul 10 20:40:18.999654 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.999252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f79fd4b55-vnq8b" event={"ID":"c948f30a-485d-4236-b86b-831a0166088c","Type":"ContainerDied","Data":"f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4"}
Jul 10 20:40:18.999654 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.999319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f79fd4b55-vnq8b" event={"ID":"c948f30a-485d-4236-b86b-831a0166088c","Type":"ContainerDied","Data":"9af0a50342ad2685b1e8b93dcbd64ce6f50e656a78a49dc78de59bb60385c7a4"}
Jul 10 20:40:18.999654 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:18.999373    2571 scope.go:117] "RemoveContainer" containerID="f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4"
Jul 10 20:40:19.007383 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:19.007367    2571 scope.go:117] "RemoveContainer" containerID="f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4"
Jul 10 20:40:19.007669 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:40:19.007642    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4\": container with ID starting with f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4 not found: ID does not exist" containerID="f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4"
Jul 10 20:40:19.007729 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:19.007683    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4"} err="failed to get container status \"f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4\": rpc error: code = NotFound desc = could not find container \"f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4\": container with ID starting with f0c25e2d1ca5327f48865bb2cba2f20d8667466129c2e6e341d05838209be3b4 not found: ID does not exist"
Jul 10 20:40:19.014015 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:19.013990    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f79fd4b55-vnq8b"]
Jul 10 20:40:19.017501 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:19.017481    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f79fd4b55-vnq8b"]
Jul 10 20:40:20.005399 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:20.005366    2571 generic.go:356] "Generic (PLEG): container finished" podID="0127dff1-2d13-44b3-9079-aa07b6f179db" containerID="98766312c8c43339efb8976dc176ef1fee69fdab7860e487c8310abe4fe32231" exitCode=0
Jul 10 20:40:20.005399 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:20.005404    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95" event={"ID":"0127dff1-2d13-44b3-9079-aa07b6f179db","Type":"ContainerDied","Data":"98766312c8c43339efb8976dc176ef1fee69fdab7860e487c8310abe4fe32231"}
Jul 10 20:40:20.005839 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:20.005703    2571 scope.go:117] "RemoveContainer" containerID="98766312c8c43339efb8976dc176ef1fee69fdab7860e487c8310abe4fe32231"
Jul 10 20:40:20.688463 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:20.688424    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c948f30a-485d-4236-b86b-831a0166088c" path="/var/lib/kubelet/pods/c948f30a-485d-4236-b86b-831a0166088c/volumes"
Jul 10 20:40:21.011999 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:21.011920    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g7h95" event={"ID":"0127dff1-2d13-44b3-9079-aa07b6f179db","Type":"ContainerStarted","Data":"75f829e98147bac837bb249d3c0f7dfb2887e628a7b1b8c9da581d11528585d1"}
Jul 10 20:40:47.614636 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:47.614592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:40:47.616940 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:47.616917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b5e65ae-4b6d-448f-b752-4a0535d4e586-metrics-certs\") pod \"network-metrics-daemon-l478j\" (UID: \"3b5e65ae-4b6d-448f-b752-4a0535d4e586\") " pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:40:47.886753 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:47.886652    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rvkjn\""
Jul 10 20:40:47.894700 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:47.894682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l478j"
Jul 10 20:40:48.020368 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:48.020338    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l478j"]
Jul 10 20:40:48.023792 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:40:48.023765    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5e65ae_4b6d_448f_b752_4a0535d4e586.slice/crio-03b8bc153470df11f9298393226028c9f5c8df5afae2dcceda628841f8f98139 WatchSource:0}: Error finding container 03b8bc153470df11f9298393226028c9f5c8df5afae2dcceda628841f8f98139: Status 404 returned error can't find the container with id 03b8bc153470df11f9298393226028c9f5c8df5afae2dcceda628841f8f98139
Jul 10 20:40:48.110427 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:48.110391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l478j" event={"ID":"3b5e65ae-4b6d-448f-b752-4a0535d4e586","Type":"ContainerStarted","Data":"03b8bc153470df11f9298393226028c9f5c8df5afae2dcceda628841f8f98139"}
Jul 10 20:40:49.116500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:49.116458    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l478j" event={"ID":"3b5e65ae-4b6d-448f-b752-4a0535d4e586","Type":"ContainerStarted","Data":"ca8ed1fb282619b70792c5a86e71d7d33ea1de538504bbd803429d08df680326"}
Jul 10 20:40:49.116882 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:49.116520    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l478j" event={"ID":"3b5e65ae-4b6d-448f-b752-4a0535d4e586","Type":"ContainerStarted","Data":"d077ec2edfcf974867a396bace39d7768dd69a876a51e4bf353d774955f3a49f"}
Jul 10 20:40:49.131258 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:40:49.131160    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l478j" podStartSLOduration=373.274760028 podStartE2EDuration="6m14.131144438s" totalImagesPullingTime="856.38441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:40:49.130356098 +0000 UTC m=+374.971076850" watchObservedRunningTime="2026-07-10 20:40:49.131144438 +0000 UTC m=+374.971865192"
Jul 10 20:41:04.698091 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698046    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5f8bb55-kwvtn"]
Jul 10 20:41:04.698584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698431    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c948f30a-485d-4236-b86b-831a0166088c" containerName="console"
Jul 10 20:41:04.698584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698449    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c948f30a-485d-4236-b86b-831a0166088c" containerName="console"
Jul 10 20:41:04.698584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698464    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8" containerName="registry"
Jul 10 20:41:04.698584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698472    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8" containerName="registry"
Jul 10 20:41:04.698584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698551    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca030f0d-94e1-4644-9e42-60c0837150e8" containerName="registry"
Jul 10 20:41:04.698584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.698562    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c948f30a-485d-4236-b86b-831a0166088c" containerName="console"
Jul 10 20:41:04.700726 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.700703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.713316 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.713292    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5f8bb55-kwvtn"]
Jul 10 20:41:04.845584 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.845540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-trusted-ca-bundle\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.845879 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.845852    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-oauth-serving-cert\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.846026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.845916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-oauth-config\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.846026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.845942    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-console-config\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.846026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.845977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-service-ca\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.846026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.846003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsp82\" (UniqueName: \"kubernetes.io/projected/c75238c6-80ab-456d-b132-9e6e55dd5855-kube-api-access-tsp82\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.846223 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.846041    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-serving-cert\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947012 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.946976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-trusted-ca-bundle\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947012 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947017    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-oauth-serving-cert\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947048    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-oauth-config\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-console-config\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-service-ca\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsp82\" (UniqueName: \"kubernetes.io/projected/c75238c6-80ab-456d-b132-9e6e55dd5855-kube-api-access-tsp82\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-serving-cert\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.947945 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-service-ca\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.948062 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947914    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-oauth-serving-cert\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.948062 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-trusted-ca-bundle\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.948062 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.947923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-console-config\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.950127 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.950087    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-serving-cert\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.950232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.950211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-oauth-config\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:04.955207 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:04.955184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsp82\" (UniqueName: \"kubernetes.io/projected/c75238c6-80ab-456d-b132-9e6e55dd5855-kube-api-access-tsp82\") pod \"console-6d5f8bb55-kwvtn\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") " pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:05.011350 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:05.011317    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:05.138912 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:05.138883    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5f8bb55-kwvtn"]
Jul 10 20:41:05.141548 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:41:05.141520    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75238c6_80ab_456d_b132_9e6e55dd5855.slice/crio-3dfa0128fff4af6b3efaeeb56acf325bf227e4a6fab8a9cc63c5286f270f968a WatchSource:0}: Error finding container 3dfa0128fff4af6b3efaeeb56acf325bf227e4a6fab8a9cc63c5286f270f968a: Status 404 returned error can't find the container with id 3dfa0128fff4af6b3efaeeb56acf325bf227e4a6fab8a9cc63c5286f270f968a
Jul 10 20:41:05.175402 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:05.175375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f8bb55-kwvtn" event={"ID":"c75238c6-80ab-456d-b132-9e6e55dd5855","Type":"ContainerStarted","Data":"3dfa0128fff4af6b3efaeeb56acf325bf227e4a6fab8a9cc63c5286f270f968a"}
Jul 10 20:41:06.180587 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:06.180554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f8bb55-kwvtn" event={"ID":"c75238c6-80ab-456d-b132-9e6e55dd5855","Type":"ContainerStarted","Data":"a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158"}
Jul 10 20:41:06.197845 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:06.197795    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d5f8bb55-kwvtn" podStartSLOduration=2.197779036 podStartE2EDuration="2.197779036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:41:06.196491578 +0000 UTC m=+392.037212331" watchObservedRunningTime="2026-07-10 20:41:06.197779036 +0000 UTC m=+392.038499788"
Jul 10 20:41:14.043495 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.043465    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5f8bb55-kwvtn"]
Jul 10 20:41:14.070863 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.070835    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-594dcccc88-cqzzd"]
Jul 10 20:41:14.073052 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.073036    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.083921 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.083900    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594dcccc88-cqzzd"]
Jul 10 20:41:14.221254 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221223    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-config\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.221441 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221265    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-service-ca\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.221441 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221293    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-serving-cert\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.221441 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbz5\" (UniqueName: \"kubernetes.io/projected/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-kube-api-access-cnbz5\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.221441 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-trusted-ca-bundle\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.221623 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-oauth-serving-cert\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.221623 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.221487    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-oauth-config\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322021 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.321987    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-trusted-ca-bundle\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-oauth-serving-cert\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322059    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-oauth-config\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-config\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-service-ca\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322161    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-serving-cert\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbz5\" (UniqueName: \"kubernetes.io/projected/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-kube-api-access-cnbz5\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.322905 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-oauth-serving-cert\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.323026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322883    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-config\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.323026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.322982    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-service-ca\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.323124 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.323057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-trusted-ca-bundle\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.324688 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.324639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-serving-cert\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.324772 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.324693    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-oauth-config\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.329482 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.329465    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbz5\" (UniqueName: \"kubernetes.io/projected/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-kube-api-access-cnbz5\") pod \"console-594dcccc88-cqzzd\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") " pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.382163 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.382127    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:14.512568 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:14.512479    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594dcccc88-cqzzd"]
Jul 10 20:41:14.514862 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:41:14.514837    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a2eb09_c19a_44e8_98af_4d51c62cfaf5.slice/crio-fbe3648c1767c1c0d9ddb74517d99dd9f9f4d2c095dba1c9b511f65287059fcf WatchSource:0}: Error finding container fbe3648c1767c1c0d9ddb74517d99dd9f9f4d2c095dba1c9b511f65287059fcf: Status 404 returned error can't find the container with id fbe3648c1767c1c0d9ddb74517d99dd9f9f4d2c095dba1c9b511f65287059fcf
Jul 10 20:41:15.011674 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:15.011580    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:15.217151 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:15.217111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594dcccc88-cqzzd" event={"ID":"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5","Type":"ContainerStarted","Data":"d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1"}
Jul 10 20:41:15.217633 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:15.217175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594dcccc88-cqzzd" event={"ID":"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5","Type":"ContainerStarted","Data":"fbe3648c1767c1c0d9ddb74517d99dd9f9f4d2c095dba1c9b511f65287059fcf"}
Jul 10 20:41:15.234991 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:15.234942    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-594dcccc88-cqzzd" podStartSLOduration=1.234927198 podStartE2EDuration="1.234927198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:41:15.233819242 +0000 UTC m=+401.074540005" watchObservedRunningTime="2026-07-10 20:41:15.234927198 +0000 UTC m=+401.075648008"
Jul 10 20:41:24.382782 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:24.382741    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:24.383221 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:24.382812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:24.387725 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:24.387706    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:25.264446 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:25.264417    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:41:25.307092 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:25.307063    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fbdd77b7-5pn2v"]
Jul 10 20:41:39.062384 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.062318    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d5f8bb55-kwvtn" podUID="c75238c6-80ab-456d-b132-9e6e55dd5855" containerName="console" containerID="cri-o://a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158" gracePeriod=15
Jul 10 20:41:39.301921 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.301896    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:39.313625 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313566    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-trusted-ca-bundle\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.313625 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313608    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsp82\" (UniqueName: \"kubernetes.io/projected/c75238c6-80ab-456d-b132-9e6e55dd5855-kube-api-access-tsp82\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.313806 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313637    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-oauth-serving-cert\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.313860 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313801    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-oauth-config\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.313860 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313841    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-service-ca\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.313939 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313906    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-console-config\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.313996 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313981    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-serving-cert\") pod \"c75238c6-80ab-456d-b132-9e6e55dd5855\" (UID: \"c75238c6-80ab-456d-b132-9e6e55dd5855\") "
Jul 10 20:41:39.314037 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.313993    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:39.314037 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.314003    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:39.314257 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.314213    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.314257 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.314236    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.314411 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.314260    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-service-ca" (OuterVolumeSpecName: "service-ca") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:39.314411 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.314358    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-console-config" (OuterVolumeSpecName: "console-config") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:39.315014 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.314991    2571 generic.go:356] "Generic (PLEG): container finished" podID="c75238c6-80ab-456d-b132-9e6e55dd5855" containerID="a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158" exitCode=0
Jul 10 20:41:39.315122 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.315046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f8bb55-kwvtn" event={"ID":"c75238c6-80ab-456d-b132-9e6e55dd5855","Type":"ContainerDied","Data":"a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158"}
Jul 10 20:41:39.315122 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.315053    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5f8bb55-kwvtn"
Jul 10 20:41:39.315122 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.315099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5f8bb55-kwvtn" event={"ID":"c75238c6-80ab-456d-b132-9e6e55dd5855","Type":"ContainerDied","Data":"3dfa0128fff4af6b3efaeeb56acf325bf227e4a6fab8a9cc63c5286f270f968a"}
Jul 10 20:41:39.315288 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.315127    2571 scope.go:117] "RemoveContainer" containerID="a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158"
Jul 10 20:41:39.316057 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.316020    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:41:39.316194 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.316160    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75238c6-80ab-456d-b132-9e6e55dd5855-kube-api-access-tsp82" (OuterVolumeSpecName: "kube-api-access-tsp82") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "kube-api-access-tsp82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:41:39.316194 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.316165    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c75238c6-80ab-456d-b132-9e6e55dd5855" (UID: "c75238c6-80ab-456d-b132-9e6e55dd5855"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:41:39.333283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.333263    2571 scope.go:117] "RemoveContainer" containerID="a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158"
Jul 10 20:41:39.333562 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:41:39.333542    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158\": container with ID starting with a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158 not found: ID does not exist" containerID="a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158"
Jul 10 20:41:39.333632 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.333580    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158"} err="failed to get container status \"a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158\": rpc error: code = NotFound desc = could not find container \"a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158\": container with ID starting with a97c35247e6973c056574d8137a11160e66aca0676680274afc489d004b91158 not found: ID does not exist"
Jul 10 20:41:39.415116 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.415084    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsp82\" (UniqueName: \"kubernetes.io/projected/c75238c6-80ab-456d-b132-9e6e55dd5855-kube-api-access-tsp82\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.415116 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.415113    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.415283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.415126    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.415283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.415138    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c75238c6-80ab-456d-b132-9e6e55dd5855-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.415283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.415149    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c75238c6-80ab-456d-b132-9e6e55dd5855-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:39.636237 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.636207    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5f8bb55-kwvtn"]
Jul 10 20:41:39.639908 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:39.639879    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d5f8bb55-kwvtn"]
Jul 10 20:41:40.687847 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:40.687813    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75238c6-80ab-456d-b132-9e6e55dd5855" path="/var/lib/kubelet/pods/c75238c6-80ab-456d-b132-9e6e55dd5855/volumes"
Jul 10 20:41:50.333331 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.333290    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85fbdd77b7-5pn2v" podUID="933877c4-2adc-45c7-b4a6-d3167c4dab5a" containerName="console" containerID="cri-o://d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795" gracePeriod=15
Jul 10 20:41:50.574480 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.574448    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:41:50.597961 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.597894    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-config\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.597961 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.597930    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-oauth-config\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.598147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.597976    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ggfl\" (UniqueName: \"kubernetes.io/projected/933877c4-2adc-45c7-b4a6-d3167c4dab5a-kube-api-access-8ggfl\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.598147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.598002    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-service-ca\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.598147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.598020    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-serving-cert\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.598147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.598052    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-oauth-serving-cert\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.598147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.598087    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-trusted-ca-bundle\") pod \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\" (UID: \"933877c4-2adc-45c7-b4a6-d3167c4dab5a\") "
Jul 10 20:41:50.598409 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.598377    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-config" (OuterVolumeSpecName: "console-config") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:50.599027 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.598392    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:50.599145 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.599032    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:50.604590 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.599264    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:41:50.605842 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.605812    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:41:50.605938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.605838    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933877c4-2adc-45c7-b4a6-d3167c4dab5a-kube-api-access-8ggfl" (OuterVolumeSpecName: "kube-api-access-8ggfl") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "kube-api-access-8ggfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:41:50.605938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.605842    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "933877c4-2adc-45c7-b4a6-d3167c4dab5a" (UID: "933877c4-2adc-45c7-b4a6-d3167c4dab5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:41:50.698639 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698615    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ggfl\" (UniqueName: \"kubernetes.io/projected/933877c4-2adc-45c7-b4a6-d3167c4dab5a-kube-api-access-8ggfl\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:50.698763 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698638    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:50.698763 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698676    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:50.698763 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698690    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:50.698763 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698700    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:50.698763 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698709    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:50.698763 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:50.698716    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/933877c4-2adc-45c7-b4a6-d3167c4dab5a-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:41:51.364679 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.364629    2571 generic.go:356] "Generic (PLEG): container finished" podID="933877c4-2adc-45c7-b4a6-d3167c4dab5a" containerID="d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795" exitCode=0
Jul 10 20:41:51.365043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.364718    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85fbdd77b7-5pn2v"
Jul 10 20:41:51.365043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.364718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbdd77b7-5pn2v" event={"ID":"933877c4-2adc-45c7-b4a6-d3167c4dab5a","Type":"ContainerDied","Data":"d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795"}
Jul 10 20:41:51.365043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.364782    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85fbdd77b7-5pn2v" event={"ID":"933877c4-2adc-45c7-b4a6-d3167c4dab5a","Type":"ContainerDied","Data":"8f3fa44f400a7104edbab4dfd3e030411d27bef51c4546f862b1316283e1f2fb"}
Jul 10 20:41:51.365043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.364809    2571 scope.go:117] "RemoveContainer" containerID="d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795"
Jul 10 20:41:51.372778 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.372763    2571 scope.go:117] "RemoveContainer" containerID="d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795"
Jul 10 20:41:51.373006 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:41:51.372992    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795\": container with ID starting with d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795 not found: ID does not exist" containerID="d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795"
Jul 10 20:41:51.373045 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.373013    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795"} err="failed to get container status \"d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795\": rpc error: code = NotFound desc = could not find container \"d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795\": container with ID starting with d555eaaa852106c2ad4673dd4282c127c8092f2b2259482f7a3694b1fda9c795 not found: ID does not exist"
Jul 10 20:41:51.379887 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.379868    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85fbdd77b7-5pn2v"]
Jul 10 20:41:51.385619 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:51.385596    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85fbdd77b7-5pn2v"]
Jul 10 20:41:52.687673 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:52.687638    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933877c4-2adc-45c7-b4a6-d3167c4dab5a" path="/var/lib/kubelet/pods/933877c4-2adc-45c7-b4a6-d3167c4dab5a/volumes"
Jul 10 20:41:54.377942 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.377908    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"]
Jul 10 20:41:54.378390 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.378310    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933877c4-2adc-45c7-b4a6-d3167c4dab5a" containerName="console"
Jul 10 20:41:54.378390 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.378328    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="933877c4-2adc-45c7-b4a6-d3167c4dab5a" containerName="console"
Jul 10 20:41:54.378390 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.378340    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75238c6-80ab-456d-b132-9e6e55dd5855" containerName="console"
Jul 10 20:41:54.378390 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.378348    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75238c6-80ab-456d-b132-9e6e55dd5855" containerName="console"
Jul 10 20:41:54.378616 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.378472    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="933877c4-2adc-45c7-b4a6-d3167c4dab5a" containerName="console"
Jul 10 20:41:54.378616 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.378485    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75238c6-80ab-456d-b132-9e6e55dd5855" containerName="console"
Jul 10 20:41:54.382652 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.382630    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.385043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.385020    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q55j2\""
Jul 10 20:41:54.385221 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.385189    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 20:41:54.385944 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.385927    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 20:41:54.389351 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.389334    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"]
Jul 10 20:41:54.425168 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.425138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x78cw\" (UniqueName: \"kubernetes.io/projected/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-kube-api-access-x78cw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.425288 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.425182    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.425288 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.425215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.525501 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.525473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x78cw\" (UniqueName: \"kubernetes.io/projected/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-kube-api-access-x78cw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.525641 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.525511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.525641 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.525532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.525944 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.525925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.525984 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.525938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.533669 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.533642    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x78cw\" (UniqueName: \"kubernetes.io/projected/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-kube-api-access-x78cw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.693347 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.693265    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:41:54.821772 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:54.821737    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"]
Jul 10 20:41:54.824644 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:41:54.824619    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47db8f01_bb39_4bc6_b387_6ca4c91ea4e0.slice/crio-9d9d1421a1784b68b180c8214259990ba7318a87db03a58de33ed91d5fd60315 WatchSource:0}: Error finding container 9d9d1421a1784b68b180c8214259990ba7318a87db03a58de33ed91d5fd60315: Status 404 returned error can't find the container with id 9d9d1421a1784b68b180c8214259990ba7318a87db03a58de33ed91d5fd60315
Jul 10 20:41:55.381193 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:41:55.381143    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2" event={"ID":"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0","Type":"ContainerStarted","Data":"9d9d1421a1784b68b180c8214259990ba7318a87db03a58de33ed91d5fd60315"}
Jul 10 20:42:01.407382 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:01.407343    2571 generic.go:356] "Generic (PLEG): container finished" podID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerID="5f1c97ab5862fbf9f5217a7b37de6dfe545711c11fb349bf538dde6dd031304c" exitCode=0
Jul 10 20:42:01.407846 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:01.407429    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2" event={"ID":"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0","Type":"ContainerDied","Data":"5f1c97ab5862fbf9f5217a7b37de6dfe545711c11fb349bf538dde6dd031304c"}
Jul 10 20:42:04.421454 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:04.421413    2571 generic.go:356] "Generic (PLEG): container finished" podID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerID="52382bf8fedc7332cca4cab88b8bd28fb67dc22c08629d1c7e7855d662974025" exitCode=0
Jul 10 20:42:04.421847 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:04.421471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2" event={"ID":"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0","Type":"ContainerDied","Data":"52382bf8fedc7332cca4cab88b8bd28fb67dc22c08629d1c7e7855d662974025"}
Jul 10 20:42:13.463005 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:13.462968    2571 generic.go:356] "Generic (PLEG): container finished" podID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerID="ef65926d6291bbe9b7fe9288cb620d366bbdceb750e0f3476566c91f1defc79b" exitCode=0
Jul 10 20:42:13.463505 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:13.463032    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2" event={"ID":"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0","Type":"ContainerDied","Data":"ef65926d6291bbe9b7fe9288cb620d366bbdceb750e0f3476566c91f1defc79b"}
Jul 10 20:42:14.625230 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.625202    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:42:14.693842 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.693815    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-util\") pod \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") "
Jul 10 20:42:14.694007 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.693893    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x78cw\" (UniqueName: \"kubernetes.io/projected/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-kube-api-access-x78cw\") pod \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") "
Jul 10 20:42:14.694007 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.693921    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-bundle\") pod \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\" (UID: \"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0\") "
Jul 10 20:42:14.694582 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.694553    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-bundle" (OuterVolumeSpecName: "bundle") pod "47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" (UID: "47db8f01-bb39-4bc6-b387-6ca4c91ea4e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:42:14.696205 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.696178    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-kube-api-access-x78cw" (OuterVolumeSpecName: "kube-api-access-x78cw") pod "47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" (UID: "47db8f01-bb39-4bc6-b387-6ca4c91ea4e0"). InnerVolumeSpecName "kube-api-access-x78cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:42:14.698826 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.698804    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-util" (OuterVolumeSpecName: "util") pod "47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" (UID: "47db8f01-bb39-4bc6-b387-6ca4c91ea4e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:42:14.794887 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.794806    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:14.794887 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.794834    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x78cw\" (UniqueName: \"kubernetes.io/projected/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-kube-api-access-x78cw\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:14.794887 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:14.794845    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47db8f01-bb39-4bc6-b387-6ca4c91ea4e0-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:15.472504 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:15.472472    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2"
Jul 10 20:42:15.472688 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:15.472504    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xc6w2" event={"ID":"47db8f01-bb39-4bc6-b387-6ca4c91ea4e0","Type":"ContainerDied","Data":"9d9d1421a1784b68b180c8214259990ba7318a87db03a58de33ed91d5fd60315"}
Jul 10 20:42:15.472688 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:15.472554    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d9d1421a1784b68b180c8214259990ba7318a87db03a58de33ed91d5fd60315"
Jul 10 20:42:22.283050 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283019    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"]
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283300    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="util"
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283312    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="util"
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283324    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="pull"
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283329    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="pull"
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283336    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="extract"
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283341    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="extract"
Jul 10 20:42:22.283425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.283392    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="47db8f01-bb39-4bc6-b387-6ca4c91ea4e0" containerName="extract"
Jul 10 20:42:22.285482 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.285466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.287840 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.287815    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-qv85s\""
Jul 10 20:42:22.287840 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.287838    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 10 20:42:22.288043 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.288031    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:42:22.300548 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.300528    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"]
Jul 10 20:42:22.353437 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.353410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkb8c\" (UniqueName: \"kubernetes.io/projected/701fdec2-803e-4c2a-a391-2020acca4336-kube-api-access-mkb8c\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfbxj\" (UID: \"701fdec2-803e-4c2a-a391-2020acca4336\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.353568 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.353465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/701fdec2-803e-4c2a-a391-2020acca4336-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfbxj\" (UID: \"701fdec2-803e-4c2a-a391-2020acca4336\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.454951 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.454911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/701fdec2-803e-4c2a-a391-2020acca4336-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfbxj\" (UID: \"701fdec2-803e-4c2a-a391-2020acca4336\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.455105 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.454975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkb8c\" (UniqueName: \"kubernetes.io/projected/701fdec2-803e-4c2a-a391-2020acca4336-kube-api-access-mkb8c\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfbxj\" (UID: \"701fdec2-803e-4c2a-a391-2020acca4336\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.455310 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.455289    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/701fdec2-803e-4c2a-a391-2020acca4336-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfbxj\" (UID: \"701fdec2-803e-4c2a-a391-2020acca4336\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.480218 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.480192    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkb8c\" (UniqueName: \"kubernetes.io/projected/701fdec2-803e-4c2a-a391-2020acca4336-kube-api-access-mkb8c\") pod \"cert-manager-operator-controller-manager-55c444bf86-qfbxj\" (UID: \"701fdec2-803e-4c2a-a391-2020acca4336\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.594286 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.594251    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"
Jul 10 20:42:22.723925 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:22.723901    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj"]
Jul 10 20:42:22.726614 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:22.726586    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701fdec2_803e_4c2a_a391_2020acca4336.slice/crio-4c1f1acf0a94b516fbcaae96155f9077e726e3e31135f699ccffa6ae9ffeb7b4 WatchSource:0}: Error finding container 4c1f1acf0a94b516fbcaae96155f9077e726e3e31135f699ccffa6ae9ffeb7b4: Status 404 returned error can't find the container with id 4c1f1acf0a94b516fbcaae96155f9077e726e3e31135f699ccffa6ae9ffeb7b4
Jul 10 20:42:23.506414 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:23.506371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj" event={"ID":"701fdec2-803e-4c2a-a391-2020acca4336","Type":"ContainerStarted","Data":"4c1f1acf0a94b516fbcaae96155f9077e726e3e31135f699ccffa6ae9ffeb7b4"}
Jul 10 20:42:24.511554 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:24.511516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj" event={"ID":"701fdec2-803e-4c2a-a391-2020acca4336","Type":"ContainerStarted","Data":"efc4f2e4dca784abbda3829512292e0af9e06271585d4bc8a981b3afc7179ad9"}
Jul 10 20:42:24.546682 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:24.546576    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qfbxj" podStartSLOduration=0.992503167 podStartE2EDuration="2.546559511s" totalImagesPullingTime="1.554056344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:42:24.543584358 +0000 UTC m=+470.384305117" watchObservedRunningTime="2026-07-10 20:42:24.546559511 +0000 UTC m=+470.387280262"
Jul 10 20:42:25.619853 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.619818    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"]
Jul 10 20:42:25.622091 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.622074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.624610 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.624585    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 20:42:25.624749 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.624586    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 20:42:25.625507 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.625492    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q55j2\""
Jul 10 20:42:25.630950 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.630925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"]
Jul 10 20:42:25.786572 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.786536    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6kqx\" (UniqueName: \"kubernetes.io/projected/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-kube-api-access-s6kqx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.786754 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.786579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.786754 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.786714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.887810 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.887727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6kqx\" (UniqueName: \"kubernetes.io/projected/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-kube-api-access-s6kqx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.887810 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.887777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.888007 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.887840    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.888133 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.888113    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.888217 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.888167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.906588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.906562    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6kqx\" (UniqueName: \"kubernetes.io/projected/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-kube-api-access-s6kqx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:25.931568 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:25.931540    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:26.062983 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.062950    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"]
Jul 10 20:42:26.065250 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:26.065219    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e6e5ef_4454_48f1_a7e0_4739cb7b5d63.slice/crio-c47f5d1f561c06e520b38ef7ba25685b5cadc1e5a1db2b4228c885abb8e0fc89 WatchSource:0}: Error finding container c47f5d1f561c06e520b38ef7ba25685b5cadc1e5a1db2b4228c885abb8e0fc89: Status 404 returned error can't find the container with id c47f5d1f561c06e520b38ef7ba25685b5cadc1e5a1db2b4228c885abb8e0fc89
Jul 10 20:42:26.521003 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.520917    2571 generic.go:356] "Generic (PLEG): container finished" podID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerID="ccc7ffa76a2631ed4ba19809b229c66e8de12578d489f604b203b9e4e1cc5d73" exitCode=0
Jul 10 20:42:26.521003 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.520963    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf" event={"ID":"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63","Type":"ContainerDied","Data":"ccc7ffa76a2631ed4ba19809b229c66e8de12578d489f604b203b9e4e1cc5d73"}
Jul 10 20:42:26.521003 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.520999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf" event={"ID":"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63","Type":"ContainerStarted","Data":"c47f5d1f561c06e520b38ef7ba25685b5cadc1e5a1db2b4228c885abb8e0fc89"}
Jul 10 20:42:26.908792 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.908756    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxz6q"]
Jul 10 20:42:26.910985 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.910859    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:26.913242 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.913221    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 20:42:26.913362 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.913305    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vzf78\""
Jul 10 20:42:26.913413 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.913386    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 20:42:26.921472 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.921451    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxz6q"]
Jul 10 20:42:26.997007 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.996968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxz6q\" (UID: \"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:26.997176 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:26.997028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbhbp\" (UniqueName: \"kubernetes.io/projected/0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939-kube-api-access-mbhbp\") pod \"cert-manager-webhook-6486ffd997-qxz6q\" (UID: \"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:27.097640 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.097600    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxz6q\" (UID: \"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:27.097856 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.097698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbhbp\" (UniqueName: \"kubernetes.io/projected/0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939-kube-api-access-mbhbp\") pod \"cert-manager-webhook-6486ffd997-qxz6q\" (UID: \"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:27.105567 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.105543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxz6q\" (UID: \"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:27.105699 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.105546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbhbp\" (UniqueName: \"kubernetes.io/projected/0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939-kube-api-access-mbhbp\") pod \"cert-manager-webhook-6486ffd997-qxz6q\" (UID: \"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:27.229506 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.229416    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:27.352545 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.352511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxz6q"]
Jul 10 20:42:27.355010 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:27.354981    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ed6a71b_57ee_4c9b_b3de_4d3e23ff6939.slice/crio-7b463db5c29b7922faad892c2d926f168b56d9c8f5506e64782a904b5b3c8063 WatchSource:0}: Error finding container 7b463db5c29b7922faad892c2d926f168b56d9c8f5506e64782a904b5b3c8063: Status 404 returned error can't find the container with id 7b463db5c29b7922faad892c2d926f168b56d9c8f5506e64782a904b5b3c8063
Jul 10 20:42:27.526751 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:27.526667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q" event={"ID":"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939","Type":"ContainerStarted","Data":"7b463db5c29b7922faad892c2d926f168b56d9c8f5506e64782a904b5b3c8063"}
Jul 10 20:42:28.130490 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.130455    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"]
Jul 10 20:42:28.132945 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.132921    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.135087 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.135061    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-nbh88\""
Jul 10 20:42:28.143436 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.143405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"]
Jul 10 20:42:28.206225 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.206189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/573ad8a7-52db-4125-a48b-5857674af500-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jsjt5\" (UID: \"573ad8a7-52db-4125-a48b-5857674af500\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.206418 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.206239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g26\" (UniqueName: \"kubernetes.io/projected/573ad8a7-52db-4125-a48b-5857674af500-kube-api-access-d4g26\") pod \"cert-manager-cainjector-559cdd8c87-jsjt5\" (UID: \"573ad8a7-52db-4125-a48b-5857674af500\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.306739 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.306694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g26\" (UniqueName: \"kubernetes.io/projected/573ad8a7-52db-4125-a48b-5857674af500-kube-api-access-d4g26\") pod \"cert-manager-cainjector-559cdd8c87-jsjt5\" (UID: \"573ad8a7-52db-4125-a48b-5857674af500\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.306969 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.306808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/573ad8a7-52db-4125-a48b-5857674af500-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jsjt5\" (UID: \"573ad8a7-52db-4125-a48b-5857674af500\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.314803 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.314777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/573ad8a7-52db-4125-a48b-5857674af500-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jsjt5\" (UID: \"573ad8a7-52db-4125-a48b-5857674af500\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.315026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.314998    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g26\" (UniqueName: \"kubernetes.io/projected/573ad8a7-52db-4125-a48b-5857674af500-kube-api-access-d4g26\") pod \"cert-manager-cainjector-559cdd8c87-jsjt5\" (UID: \"573ad8a7-52db-4125-a48b-5857674af500\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.445183 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.445093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"
Jul 10 20:42:28.590873 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:28.590832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5"]
Jul 10 20:42:28.594617 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:28.594588    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod573ad8a7_52db_4125_a48b_5857674af500.slice/crio-5bf81b1492ed844a113b61162dfd9ba80e38aa5ba4841b9dd14750be995dcea5 WatchSource:0}: Error finding container 5bf81b1492ed844a113b61162dfd9ba80e38aa5ba4841b9dd14750be995dcea5: Status 404 returned error can't find the container with id 5bf81b1492ed844a113b61162dfd9ba80e38aa5ba4841b9dd14750be995dcea5
Jul 10 20:42:29.539592 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:29.539549    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5" event={"ID":"573ad8a7-52db-4125-a48b-5857674af500","Type":"ContainerStarted","Data":"5bf81b1492ed844a113b61162dfd9ba80e38aa5ba4841b9dd14750be995dcea5"}
Jul 10 20:42:30.547098 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:30.546981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q" event={"ID":"0ed6a71b-57ee-4c9b-b3de-4d3e23ff6939","Type":"ContainerStarted","Data":"e4103a6a02125c07ac5fbd7a7b27feb7793b0d4a3f87155a2c28072d32bc469d"}
Jul 10 20:42:30.547098 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:30.547070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:30.548758 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:30.548722    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5" event={"ID":"573ad8a7-52db-4125-a48b-5857674af500","Type":"ContainerStarted","Data":"3c08e9d8e3f6a71770c1cf83797960c736876634ea2bee2098678318ef6a2e3a"}
Jul 10 20:42:30.570297 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:30.569701    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q" podStartSLOduration=2.047120316 podStartE2EDuration="4.569679172s" totalImagesPullingTime="2.522558856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:42:30.563826416 +0000 UTC m=+476.404547167" watchObservedRunningTime="2026-07-10 20:42:30.569679172 +0000 UTC m=+476.410399924"
Jul 10 20:42:31.554798 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:31.554766    2571 generic.go:356] "Generic (PLEG): container finished" podID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerID="6f0d0bcf1a5f047f3bd7480e3949b20415051c88e5add058551404a548b6f11a" exitCode=0
Jul 10 20:42:31.555224 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:31.554860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf" event={"ID":"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63","Type":"ContainerDied","Data":"6f0d0bcf1a5f047f3bd7480e3949b20415051c88e5add058551404a548b6f11a"}
Jul 10 20:42:31.589961 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:31.589891    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jsjt5" podStartSLOduration=2.307410742 podStartE2EDuration="3.5898759s" totalImagesPullingTime="1.282465158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:42:30.597406112 +0000 UTC m=+476.438126875" watchObservedRunningTime="2026-07-10 20:42:31.5898759 +0000 UTC m=+477.430596652"
Jul 10 20:42:32.561611 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:32.561576    2571 generic.go:356] "Generic (PLEG): container finished" podID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerID="7cbc7a596ce2978e7fad7319e9ff7aa31e4411c9bba16c18c7b0700aeafea1d8" exitCode=0
Jul 10 20:42:32.562004 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:32.561648    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf" event={"ID":"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63","Type":"ContainerDied","Data":"7cbc7a596ce2978e7fad7319e9ff7aa31e4411c9bba16c18c7b0700aeafea1d8"}
Jul 10 20:42:33.690824 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.690800    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:33.857791 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.857688    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-bundle\") pod \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") "
Jul 10 20:42:33.857791 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.857773    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-util\") pod \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") "
Jul 10 20:42:33.857998 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.857835    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6kqx\" (UniqueName: \"kubernetes.io/projected/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-kube-api-access-s6kqx\") pod \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\" (UID: \"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63\") "
Jul 10 20:42:33.858196 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.858159    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-bundle" (OuterVolumeSpecName: "bundle") pod "e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" (UID: "e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:42:33.859936 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.859912    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-kube-api-access-s6kqx" (OuterVolumeSpecName: "kube-api-access-s6kqx") pod "e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" (UID: "e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63"). InnerVolumeSpecName "kube-api-access-s6kqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:42:33.862410 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.862378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-util" (OuterVolumeSpecName: "util") pod "e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" (UID: "e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:42:33.959363 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.959327    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6kqx\" (UniqueName: \"kubernetes.io/projected/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-kube-api-access-s6kqx\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:33.959363 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.959356    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:33.959363 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:33.959366    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:34.571764 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:34.571735    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf"
Jul 10 20:42:34.571764 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:34.571746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fl4mlf" event={"ID":"e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63","Type":"ContainerDied","Data":"c47f5d1f561c06e520b38ef7ba25685b5cadc1e5a1db2b4228c885abb8e0fc89"}
Jul 10 20:42:34.571959 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:34.571786    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c47f5d1f561c06e520b38ef7ba25685b5cadc1e5a1db2b4228c885abb8e0fc89"
Jul 10 20:42:36.557719 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.557685    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qxz6q"
Jul 10 20:42:36.876291 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876208    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-w8vtz"]
Jul 10 20:42:36.876501 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876489    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="extract"
Jul 10 20:42:36.876544 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876503    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="extract"
Jul 10 20:42:36.876544 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876513    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="util"
Jul 10 20:42:36.876544 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876518    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="util"
Jul 10 20:42:36.876544 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876524    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="pull"
Jul 10 20:42:36.876544 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876530    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="pull"
Jul 10 20:42:36.876759 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.876586    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e6e5ef-4454-48f1-a7e0-4739cb7b5d63" containerName="extract"
Jul 10 20:42:36.882328 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.882310    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:36.884694 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.884671    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kn84x\""
Jul 10 20:42:36.888979 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.888952    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-w8vtz"]
Jul 10 20:42:36.982675 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.982624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rsvb\" (UniqueName: \"kubernetes.io/projected/cca1f956-4c69-470f-be36-d3327daf25e6-kube-api-access-4rsvb\") pod \"cert-manager-55b4d954d5-w8vtz\" (UID: \"cca1f956-4c69-470f-be36-d3327daf25e6\") " pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:36.982836 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:36.982754    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cca1f956-4c69-470f-be36-d3327daf25e6-bound-sa-token\") pod \"cert-manager-55b4d954d5-w8vtz\" (UID: \"cca1f956-4c69-470f-be36-d3327daf25e6\") " pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:37.083289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.083248    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rsvb\" (UniqueName: \"kubernetes.io/projected/cca1f956-4c69-470f-be36-d3327daf25e6-kube-api-access-4rsvb\") pod \"cert-manager-55b4d954d5-w8vtz\" (UID: \"cca1f956-4c69-470f-be36-d3327daf25e6\") " pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:37.083451 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.083333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cca1f956-4c69-470f-be36-d3327daf25e6-bound-sa-token\") pod \"cert-manager-55b4d954d5-w8vtz\" (UID: \"cca1f956-4c69-470f-be36-d3327daf25e6\") " pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:37.091006 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.090983    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cca1f956-4c69-470f-be36-d3327daf25e6-bound-sa-token\") pod \"cert-manager-55b4d954d5-w8vtz\" (UID: \"cca1f956-4c69-470f-be36-d3327daf25e6\") " pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:37.091292 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.091271    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rsvb\" (UniqueName: \"kubernetes.io/projected/cca1f956-4c69-470f-be36-d3327daf25e6-kube-api-access-4rsvb\") pod \"cert-manager-55b4d954d5-w8vtz\" (UID: \"cca1f956-4c69-470f-be36-d3327daf25e6\") " pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:37.192641 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.192561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-w8vtz"
Jul 10 20:42:37.321342 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.321317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-w8vtz"]
Jul 10 20:42:37.323693 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:37.323629    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcca1f956_4c69_470f_be36_d3327daf25e6.slice/crio-c05d733103e5513f6dd4e5ac63b7fc75dd3442ee5350a1521f49619a9941ae59 WatchSource:0}: Error finding container c05d733103e5513f6dd4e5ac63b7fc75dd3442ee5350a1521f49619a9941ae59: Status 404 returned error can't find the container with id c05d733103e5513f6dd4e5ac63b7fc75dd3442ee5350a1521f49619a9941ae59
Jul 10 20:42:37.585609 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.585581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-w8vtz" event={"ID":"cca1f956-4c69-470f-be36-d3327daf25e6","Type":"ContainerStarted","Data":"c9522ecc15d8b97a044577c1ad4a5965aa4576c2850f66cc0470ea794b5f5fd6"}
Jul 10 20:42:37.586011 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.585621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-w8vtz" event={"ID":"cca1f956-4c69-470f-be36-d3327daf25e6","Type":"ContainerStarted","Data":"c05d733103e5513f6dd4e5ac63b7fc75dd3442ee5350a1521f49619a9941ae59"}
Jul 10 20:42:37.600342 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:37.600299    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-w8vtz" podStartSLOduration=1.600284933 podStartE2EDuration="1.600284933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:42:37.599044725 +0000 UTC m=+483.439765478" watchObservedRunningTime="2026-07-10 20:42:37.600284933 +0000 UTC m=+483.441005684"
Jul 10 20:42:47.670192 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.670160    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"]
Jul 10 20:42:47.674730 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.674714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.676982 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.676960    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 20:42:47.676982 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.676980    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q55j2\""
Jul 10 20:42:47.677835 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.677818    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 20:42:47.681110 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.681089    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"]
Jul 10 20:42:47.765378 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.765347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhh8g\" (UniqueName: \"kubernetes.io/projected/84784a6f-bfcc-41e9-8d15-007091d9e561-kube-api-access-fhh8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.765516 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.765413    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.765516 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.765448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.866353 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.866321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhh8g\" (UniqueName: \"kubernetes.io/projected/84784a6f-bfcc-41e9-8d15-007091d9e561-kube-api-access-fhh8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.866501 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.866370    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.866501 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.866391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.866737 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.866721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.866777 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.866749    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.873963 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.873935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhh8g\" (UniqueName: \"kubernetes.io/projected/84784a6f-bfcc-41e9-8d15-007091d9e561-kube-api-access-fhh8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:47.985387 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:47.985304    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:48.111065 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:48.111040    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"]
Jul 10 20:42:48.113020 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:48.112993    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84784a6f_bfcc_41e9_8d15_007091d9e561.slice/crio-68b3d25cefd79dc7e7d924795d42d3202a364a7681461907576f14b2d531988f WatchSource:0}: Error finding container 68b3d25cefd79dc7e7d924795d42d3202a364a7681461907576f14b2d531988f: Status 404 returned error can't find the container with id 68b3d25cefd79dc7e7d924795d42d3202a364a7681461907576f14b2d531988f
Jul 10 20:42:48.636072 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:48.636039    2571 generic.go:356] "Generic (PLEG): container finished" podID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerID="bdd83ab81dbc6bf34fa0abe184b7eb90accdb382a64a7b8180c8cd0775845ac8" exitCode=0
Jul 10 20:42:48.636281 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:48.636128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6" event={"ID":"84784a6f-bfcc-41e9-8d15-007091d9e561","Type":"ContainerDied","Data":"bdd83ab81dbc6bf34fa0abe184b7eb90accdb382a64a7b8180c8cd0775845ac8"}
Jul 10 20:42:48.636281 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:48.636178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6" event={"ID":"84784a6f-bfcc-41e9-8d15-007091d9e561","Type":"ContainerStarted","Data":"68b3d25cefd79dc7e7d924795d42d3202a364a7681461907576f14b2d531988f"}
Jul 10 20:42:49.642313 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:49.642277    2571 generic.go:356] "Generic (PLEG): container finished" podID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerID="ce2bfbd62b1f81c153b0875cb437f5afe2ecd5e171d0e9be8b34d75bbd4aea63" exitCode=0
Jul 10 20:42:49.642717 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:49.642359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6" event={"ID":"84784a6f-bfcc-41e9-8d15-007091d9e561","Type":"ContainerDied","Data":"ce2bfbd62b1f81c153b0875cb437f5afe2ecd5e171d0e9be8b34d75bbd4aea63"}
Jul 10 20:42:50.648914 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:50.648872    2571 generic.go:356] "Generic (PLEG): container finished" podID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerID="f7348cbb64813f8976d4a6ecdc9fc419e558b7166ffe33ba4438375c366bc4c0" exitCode=0
Jul 10 20:42:50.649279 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:50.648925    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6" event={"ID":"84784a6f-bfcc-41e9-8d15-007091d9e561","Type":"ContainerDied","Data":"f7348cbb64813f8976d4a6ecdc9fc419e558b7166ffe33ba4438375c366bc4c0"}
Jul 10 20:42:51.786354 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.786322    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:51.896196 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.896162    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-util\") pod \"84784a6f-bfcc-41e9-8d15-007091d9e561\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") "
Jul 10 20:42:51.896425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.896207    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhh8g\" (UniqueName: \"kubernetes.io/projected/84784a6f-bfcc-41e9-8d15-007091d9e561-kube-api-access-fhh8g\") pod \"84784a6f-bfcc-41e9-8d15-007091d9e561\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") "
Jul 10 20:42:51.896425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.896226    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-bundle\") pod \"84784a6f-bfcc-41e9-8d15-007091d9e561\" (UID: \"84784a6f-bfcc-41e9-8d15-007091d9e561\") "
Jul 10 20:42:51.896946 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.896923    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-bundle" (OuterVolumeSpecName: "bundle") pod "84784a6f-bfcc-41e9-8d15-007091d9e561" (UID: "84784a6f-bfcc-41e9-8d15-007091d9e561"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:42:51.898274 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.898249    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84784a6f-bfcc-41e9-8d15-007091d9e561-kube-api-access-fhh8g" (OuterVolumeSpecName: "kube-api-access-fhh8g") pod "84784a6f-bfcc-41e9-8d15-007091d9e561" (UID: "84784a6f-bfcc-41e9-8d15-007091d9e561"). InnerVolumeSpecName "kube-api-access-fhh8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:42:51.901650 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.901617    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-util" (OuterVolumeSpecName: "util") pod "84784a6f-bfcc-41e9-8d15-007091d9e561" (UID: "84784a6f-bfcc-41e9-8d15-007091d9e561"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:42:51.997591 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.997511    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:51.997591 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.997539    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhh8g\" (UniqueName: \"kubernetes.io/projected/84784a6f-bfcc-41e9-8d15-007091d9e561-kube-api-access-fhh8g\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:51.997591 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:51.997550    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84784a6f-bfcc-41e9-8d15-007091d9e561-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:42:52.659954 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:52.659925    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6" event={"ID":"84784a6f-bfcc-41e9-8d15-007091d9e561","Type":"ContainerDied","Data":"68b3d25cefd79dc7e7d924795d42d3202a364a7681461907576f14b2d531988f"}
Jul 10 20:42:52.660132 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:52.659965    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afqnsd6"
Jul 10 20:42:52.660132 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:52.659977    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68b3d25cefd79dc7e7d924795d42d3202a364a7681461907576f14b2d531988f"
Jul 10 20:42:56.582680 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.582620    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"]
Jul 10 20:42:56.583066 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.582972    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="util"
Jul 10 20:42:56.583066 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.582984    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="util"
Jul 10 20:42:56.583066 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.582999    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="pull"
Jul 10 20:42:56.583066 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.583005    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="pull"
Jul 10 20:42:56.583066 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.583012    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="extract"
Jul 10 20:42:56.583066 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.583017    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="extract"
Jul 10 20:42:56.583251 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.583076    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="84784a6f-bfcc-41e9-8d15-007091d9e561" containerName="extract"
Jul 10 20:42:56.585537 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.585517    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.588391 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.588369    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 20:42:56.589346 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.589325    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 20:42:56.589458 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.589344    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 20:42:56.589458 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.589366    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 20:42:56.589575 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.589459    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 20:42:56.589625 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.589600    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c4tjt\""
Jul 10 20:42:56.597090 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.597067    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"]
Jul 10 20:42:56.633566 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.633519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c7adcc2-0b3b-4895-8c44-eb3922d90578-cert\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.633566 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.633547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c7adcc2-0b3b-4895-8c44-eb3922d90578-metrics-cert\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.633906 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.633589    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4lm\" (UniqueName: \"kubernetes.io/projected/9c7adcc2-0b3b-4895-8c44-eb3922d90578-kube-api-access-qw4lm\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.633906 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.633608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c7adcc2-0b3b-4895-8c44-eb3922d90578-manager-config\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.734232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.734199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c7adcc2-0b3b-4895-8c44-eb3922d90578-cert\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.734232 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.734232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c7adcc2-0b3b-4895-8c44-eb3922d90578-metrics-cert\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.734457 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.734263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4lm\" (UniqueName: \"kubernetes.io/projected/9c7adcc2-0b3b-4895-8c44-eb3922d90578-kube-api-access-qw4lm\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.734457 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.734280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c7adcc2-0b3b-4895-8c44-eb3922d90578-manager-config\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.734937 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.734918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c7adcc2-0b3b-4895-8c44-eb3922d90578-manager-config\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.736811 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.736779    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c7adcc2-0b3b-4895-8c44-eb3922d90578-metrics-cert\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.736811 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.736789    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c7adcc2-0b3b-4895-8c44-eb3922d90578-cert\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.743404 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.743384    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4lm\" (UniqueName: \"kubernetes.io/projected/9c7adcc2-0b3b-4895-8c44-eb3922d90578-kube-api-access-qw4lm\") pod \"lws-controller-manager-7c5b7cd584-9l4j8\" (UID: \"9c7adcc2-0b3b-4895-8c44-eb3922d90578\") " pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:56.895062 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:56.894976    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:57.043376 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:57.043353    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"]
Jul 10 20:42:57.045996 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:42:57.045968    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7adcc2_0b3b_4895_8c44_eb3922d90578.slice/crio-f2b3db9bdfa1e1901a8f553be75dc0617cfc45f678d07aac191a6125ef19c614 WatchSource:0}: Error finding container f2b3db9bdfa1e1901a8f553be75dc0617cfc45f678d07aac191a6125ef19c614: Status 404 returned error can't find the container with id f2b3db9bdfa1e1901a8f553be75dc0617cfc45f678d07aac191a6125ef19c614
Jul 10 20:42:57.683524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:57.683488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8" event={"ID":"9c7adcc2-0b3b-4895-8c44-eb3922d90578","Type":"ContainerStarted","Data":"f2b3db9bdfa1e1901a8f553be75dc0617cfc45f678d07aac191a6125ef19c614"}
Jul 10 20:42:59.694192 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:59.694153    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8" event={"ID":"9c7adcc2-0b3b-4895-8c44-eb3922d90578","Type":"ContainerStarted","Data":"07265de9bf012858c52b18034d6fc7b615885a3e90e530fe0df242702957f02b"}
Jul 10 20:42:59.694634 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:59.694246    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:42:59.709528 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:42:59.709486    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8" podStartSLOduration=1.822051599 podStartE2EDuration="3.709471215s" totalImagesPullingTime="1.887419616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:42:59.708745545 +0000 UTC m=+505.549466300" watchObservedRunningTime="2026-07-10 20:42:59.709471215 +0000 UTC m=+505.550191967"
Jul 10 20:43:04.571509 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.571470    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"]
Jul 10 20:43:04.574492 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.574466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.578488 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.578469    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 20:43:04.578714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.578699    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t5qrt\""
Jul 10 20:43:04.579073 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.579059    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 20:43:04.579376 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.579361    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 20:43:04.579484 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.579464    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 20:43:04.613781 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.613757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"]
Jul 10 20:43:04.702975 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.702940    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df76b25d-c484-4903-aa56-1c992aa5aa15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.703168 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.702990    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-889xt\" (UniqueName: \"kubernetes.io/projected/df76b25d-c484-4903-aa56-1c992aa5aa15-kube-api-access-889xt\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.703168 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.703018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df76b25d-c484-4903-aa56-1c992aa5aa15-tmp\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.703168 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.703043    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df76b25d-c484-4903-aa56-1c992aa5aa15-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.703168 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.703082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df76b25d-c484-4903-aa56-1c992aa5aa15-manifests\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.803617 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.803577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df76b25d-c484-4903-aa56-1c992aa5aa15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.803823 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.803629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-889xt\" (UniqueName: \"kubernetes.io/projected/df76b25d-c484-4903-aa56-1c992aa5aa15-kube-api-access-889xt\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.803823 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.803699    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df76b25d-c484-4903-aa56-1c992aa5aa15-tmp\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.803823 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.803731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df76b25d-c484-4903-aa56-1c992aa5aa15-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.803823 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.803766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df76b25d-c484-4903-aa56-1c992aa5aa15-manifests\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.804134 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.804104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df76b25d-c484-4903-aa56-1c992aa5aa15-manifests\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.806021 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.806000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df76b25d-c484-4903-aa56-1c992aa5aa15-tmp\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.806242 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.806221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df76b25d-c484-4903-aa56-1c992aa5aa15-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.806309 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.806274    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df76b25d-c484-4903-aa56-1c992aa5aa15-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.810947 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.810922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-889xt\" (UniqueName: \"kubernetes.io/projected/df76b25d-c484-4903-aa56-1c992aa5aa15-kube-api-access-889xt\") pod \"opendatahub-operator-controller-manager-d5798c7df-whp96\" (UID: \"df76b25d-c484-4903-aa56-1c992aa5aa15\") " pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:04.885026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:04.884938    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:05.020686 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:05.020648    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"]
Jul 10 20:43:05.022902 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:43:05.022866    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf76b25d_c484_4903_aa56_1c992aa5aa15.slice/crio-29fc1d3cb9fb0ce40ff07e412c1d2025aba01025b882066d9cd60914c1f077b6 WatchSource:0}: Error finding container 29fc1d3cb9fb0ce40ff07e412c1d2025aba01025b882066d9cd60914c1f077b6: Status 404 returned error can't find the container with id 29fc1d3cb9fb0ce40ff07e412c1d2025aba01025b882066d9cd60914c1f077b6
Jul 10 20:43:05.724229 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:05.724192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96" event={"ID":"df76b25d-c484-4903-aa56-1c992aa5aa15","Type":"ContainerStarted","Data":"29fc1d3cb9fb0ce40ff07e412c1d2025aba01025b882066d9cd60914c1f077b6"}
Jul 10 20:43:08.740461 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:08.740418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96" event={"ID":"df76b25d-c484-4903-aa56-1c992aa5aa15","Type":"ContainerStarted","Data":"de4695a8bf1f3c09312762b0771b09dbba8ebffde4713209a37fd4e3fbafea24"}
Jul 10 20:43:09.745970 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:09.745934    2571 generic.go:356] "Generic (PLEG): container finished" podID="df76b25d-c484-4903-aa56-1c992aa5aa15" containerID="de4695a8bf1f3c09312762b0771b09dbba8ebffde4713209a37fd4e3fbafea24" exitCode=0
Jul 10 20:43:09.746366 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:09.745996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96" event={"ID":"df76b25d-c484-4903-aa56-1c992aa5aa15","Type":"ContainerDied","Data":"de4695a8bf1f3c09312762b0771b09dbba8ebffde4713209a37fd4e3fbafea24"}
Jul 10 20:43:10.701133 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:10.701102    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c5b7cd584-9l4j8"
Jul 10 20:43:10.752781 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:10.752752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96" event={"ID":"df76b25d-c484-4903-aa56-1c992aa5aa15","Type":"ContainerStarted","Data":"5cc2fd0d06d3c900a4870e9b299f3e9ecf708e46a505e2699d731e4200c94a3e"}
Jul 10 20:43:10.753142 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:10.752895    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:10.772607 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:10.772552    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96" podStartSLOduration=2.346325191 podStartE2EDuration="6.772536149s" totalImagesPullingTime="3.329323462s" totalInitContainerRuntime="1.096887496s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:43:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:43:10.770946087 +0000 UTC m=+516.611666841" watchObservedRunningTime="2026-07-10 20:43:10.772536149 +0000 UTC m=+516.613256901"
Jul 10 20:43:21.758959 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:21.758925    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5798c7df-whp96"
Jul 10 20:43:29.066950 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.066866    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d744644f5-25897"]
Jul 10 20:43:29.070209 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.070187    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.072641 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.072619    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 20:43:29.072884 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.072630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 20:43:29.072953 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.072716    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m6l6d\""
Jul 10 20:43:29.073011 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.072727    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 20:43:29.073438 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.073404    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 20:43:29.079974 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.079955    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d744644f5-25897"]
Jul 10 20:43:29.208205 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.208179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tmp\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.208425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.208217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tls-certs\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.208425 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.208356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgsd\" (UniqueName: \"kubernetes.io/projected/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-kube-api-access-wqgsd\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.308926 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.308896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tmp\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.309081 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.308944    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tls-certs\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.309081 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.309013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgsd\" (UniqueName: \"kubernetes.io/projected/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-kube-api-access-wqgsd\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.309178 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:43:29.309148    2571 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 10 20:43:29.309236 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:43:29.309223    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tls-certs podName:04e76c19-b77e-4a50-b9ee-43d65bc6fc55 nodeName:}" failed. No retries permitted until 2026-07-10 20:43:29.809203438 +0000 UTC m=+535.649924182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tls-certs") pod "kube-auth-proxy-7d744644f5-25897" (UID: "04e76c19-b77e-4a50-b9ee-43d65bc6fc55") : secret "kube-auth-proxy-tls" not found
Jul 10 20:43:29.311144 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.311116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tmp\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.317326 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.317262    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgsd\" (UniqueName: \"kubernetes.io/projected/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-kube-api-access-wqgsd\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.812754 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.812723    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tls-certs\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.815055 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.815032    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04e76c19-b77e-4a50-b9ee-43d65bc6fc55-tls-certs\") pod \"kube-auth-proxy-7d744644f5-25897\" (UID: \"04e76c19-b77e-4a50-b9ee-43d65bc6fc55\") " pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:29.981890 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:29.981856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897"
Jul 10 20:43:30.122316 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:30.122283    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d744644f5-25897"]
Jul 10 20:43:30.124042 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:43:30.124012    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e76c19_b77e_4a50_b9ee_43d65bc6fc55.slice/crio-ed01a4325fd84f1c75a0e4efc56666b07c6e267129a5b5d30461a3769de1446d WatchSource:0}: Error finding container ed01a4325fd84f1c75a0e4efc56666b07c6e267129a5b5d30461a3769de1446d: Status 404 returned error can't find the container with id ed01a4325fd84f1c75a0e4efc56666b07c6e267129a5b5d30461a3769de1446d
Jul 10 20:43:30.847147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:30.847112    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897" event={"ID":"04e76c19-b77e-4a50-b9ee-43d65bc6fc55","Type":"ContainerStarted","Data":"ed01a4325fd84f1c75a0e4efc56666b07c6e267129a5b5d30461a3769de1446d"}
Jul 10 20:43:33.865489 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:33.865450    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897" event={"ID":"04e76c19-b77e-4a50-b9ee-43d65bc6fc55","Type":"ContainerStarted","Data":"f5355927194a9826605e3dc1cb024e9cbf7ada5f392459f35c35254002a83c3b"}
Jul 10 20:43:33.894123 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:43:33.894053    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d744644f5-25897" podStartSLOduration=1.7729859590000001 podStartE2EDuration="4.894030887s" totalImagesPullingTime="3.121044928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:43:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:43:33.89208947 +0000 UTC m=+539.732810221" watchObservedRunningTime="2026-07-10 20:43:33.894030887 +0000 UTC m=+539.734751644"
Jul 10 20:44:34.619637 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:34.619610    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:44:34.621837 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:34.621819    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:44:47.327851 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.327819    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"]
Jul 10 20:44:47.331214 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.331198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.334143 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.334119    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vbv2p\""
Jul 10 20:44:47.334143 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.334139    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 20:44:47.334349 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.334127    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 20:44:47.340095 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.340071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"]
Jul 10 20:44:47.350095 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.350068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.350213 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.350124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgcgc\" (UniqueName: \"kubernetes.io/projected/8704a693-1329-4d73-a9c1-2c46b9d2361d-kube-api-access-kgcgc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.350213 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.350147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.435720 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.435648    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"]
Jul 10 20:44:47.440601 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.440579    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.448543 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.448518    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"]
Jul 10 20:44:47.450590 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.450725 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-952n9\" (UniqueName: \"kubernetes.io/projected/814f7860-4ba5-4d5c-b3f4-2348e1facb74-kube-api-access-952n9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.450725 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.450853 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.450853 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450780    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.450853 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgcgc\" (UniqueName: \"kubernetes.io/projected/8704a693-1329-4d73-a9c1-2c46b9d2361d-kube-api-access-kgcgc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.451014 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.450999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.451075 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.451024    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.460041 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.460020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgcgc\" (UniqueName: \"kubernetes.io/projected/8704a693-1329-4d73-a9c1-2c46b9d2361d-kube-api-access-kgcgc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.531647 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.531614    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"]
Jul 10 20:44:47.535144 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.535124    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.549243 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.549219    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"]
Jul 10 20:44:47.551471 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.551588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-952n9\" (UniqueName: \"kubernetes.io/projected/814f7860-4ba5-4d5c-b3f4-2348e1facb74-kube-api-access-952n9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.551588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.551758 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.551877 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551775    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.551877 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551815    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dckw\" (UniqueName: \"kubernetes.io/projected/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-kube-api-access-9dckw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.551995 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.551978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.552086 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.552067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.560381 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.560356    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-952n9\" (UniqueName: \"kubernetes.io/projected/814f7860-4ba5-4d5c-b3f4-2348e1facb74-kube-api-access-952n9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.637474 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.637405    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"]
Jul 10 20:44:47.640977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.640960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.641038 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.640993    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:47.650986 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.650963    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"]
Jul 10 20:44:47.652419 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.652533 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.652533 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652472    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dckw\" (UniqueName: \"kubernetes.io/projected/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-kube-api-access-9dckw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.652638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.652638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsl26\" (UniqueName: \"kubernetes.io/projected/d7e957eb-0aa6-477f-9e18-e6cf0db80416-kube-api-access-vsl26\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.652638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.652909 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.652889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.653120 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.653014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.664080 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.664053    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dckw\" (UniqueName: \"kubernetes.io/projected/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-kube-api-access-9dckw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.750852 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.750817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:47.753301 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.753268    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.753451 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.753308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsl26\" (UniqueName: \"kubernetes.io/projected/d7e957eb-0aa6-477f-9e18-e6cf0db80416-kube-api-access-vsl26\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.754004 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.753522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.754004 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.753717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.754004 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.753988    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.763174 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.763045    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsl26\" (UniqueName: \"kubernetes.io/projected/d7e957eb-0aa6-477f-9e18-e6cf0db80416-kube-api-access-vsl26\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.780941 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.780910    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"]
Jul 10 20:44:47.782704 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:44:47.782672    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8704a693_1329_4d73_a9c1_2c46b9d2361d.slice/crio-bf6ae81c2d5a5ec8f274e7300f60370f6dbf538fa8ef06ae4a8d3dfa88cbedf8 WatchSource:0}: Error finding container bf6ae81c2d5a5ec8f274e7300f60370f6dbf538fa8ef06ae4a8d3dfa88cbedf8: Status 404 returned error can't find the container with id bf6ae81c2d5a5ec8f274e7300f60370f6dbf538fa8ef06ae4a8d3dfa88cbedf8
Jul 10 20:44:47.844515 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.844487    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:47.894528 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.894495    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"]
Jul 10 20:44:47.895731 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:44:47.895696    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814f7860_4ba5_4d5c_b3f4_2348e1facb74.slice/crio-0a679f91b11057c8ce53bdc89690a363e575a6bb507413cce46295da8c2e1929 WatchSource:0}: Error finding container 0a679f91b11057c8ce53bdc89690a363e575a6bb507413cce46295da8c2e1929: Status 404 returned error can't find the container with id 0a679f91b11057c8ce53bdc89690a363e575a6bb507413cce46295da8c2e1929
Jul 10 20:44:47.951102 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.951066    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:47.988535 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:47.988510    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"]
Jul 10 20:44:47.990455 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:44:47.990429    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e4f520_0a5e_459b_bf4d_2ff48a28d73c.slice/crio-93f7d20e41ed59a5f2f96e13b3f6059adde153144d24afef9fb44aa6bd16aacd WatchSource:0}: Error finding container 93f7d20e41ed59a5f2f96e13b3f6059adde153144d24afef9fb44aa6bd16aacd: Status 404 returned error can't find the container with id 93f7d20e41ed59a5f2f96e13b3f6059adde153144d24afef9fb44aa6bd16aacd
Jul 10 20:44:48.102874 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.102848    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"]
Jul 10 20:44:48.148503 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:44:48.148434    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e957eb_0aa6_477f_9e18_e6cf0db80416.slice/crio-0cc35bd2332230299b89e6d3249b0871259c4f68ccf2bc169810bfbe85df50fc WatchSource:0}: Error finding container 0cc35bd2332230299b89e6d3249b0871259c4f68ccf2bc169810bfbe85df50fc: Status 404 returned error can't find the container with id 0cc35bd2332230299b89e6d3249b0871259c4f68ccf2bc169810bfbe85df50fc
Jul 10 20:44:48.202528 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.202464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz" event={"ID":"d7e957eb-0aa6-477f-9e18-e6cf0db80416","Type":"ContainerStarted","Data":"0cc35bd2332230299b89e6d3249b0871259c4f68ccf2bc169810bfbe85df50fc"}
Jul 10 20:44:48.203881 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.203857    2571 generic.go:356] "Generic (PLEG): container finished" podID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerID="343e183d01f3462e3b09cae6331a5008f573414c227bcab852c343b4ae242666" exitCode=0
Jul 10 20:44:48.203977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.203933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl" event={"ID":"11e4f520-0a5e-459b-bf4d-2ff48a28d73c","Type":"ContainerDied","Data":"343e183d01f3462e3b09cae6331a5008f573414c227bcab852c343b4ae242666"}
Jul 10 20:44:48.203977 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.203971    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl" event={"ID":"11e4f520-0a5e-459b-bf4d-2ff48a28d73c","Type":"ContainerStarted","Data":"93f7d20e41ed59a5f2f96e13b3f6059adde153144d24afef9fb44aa6bd16aacd"}
Jul 10 20:44:48.204375 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.204357    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 20:44:48.205500 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.205480    2571 generic.go:356] "Generic (PLEG): container finished" podID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerID="27dcb5dcd77cdfef070e4e4ed825b054dce802221bb091aa163deb5ed91b8824" exitCode=0
Jul 10 20:44:48.205586 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.205565    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h" event={"ID":"8704a693-1329-4d73-a9c1-2c46b9d2361d","Type":"ContainerDied","Data":"27dcb5dcd77cdfef070e4e4ed825b054dce802221bb091aa163deb5ed91b8824"}
Jul 10 20:44:48.205670 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.205608    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h" event={"ID":"8704a693-1329-4d73-a9c1-2c46b9d2361d","Type":"ContainerStarted","Data":"bf6ae81c2d5a5ec8f274e7300f60370f6dbf538fa8ef06ae4a8d3dfa88cbedf8"}
Jul 10 20:44:48.207135 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.207114    2571 generic.go:356] "Generic (PLEG): container finished" podID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerID="b40ba6050b320db4b8998e0f0cbcb8862d43b5d3ecdb7e7056d11a3146d47594" exitCode=0
Jul 10 20:44:48.207217 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.207165    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp" event={"ID":"814f7860-4ba5-4d5c-b3f4-2348e1facb74","Type":"ContainerDied","Data":"b40ba6050b320db4b8998e0f0cbcb8862d43b5d3ecdb7e7056d11a3146d47594"}
Jul 10 20:44:48.207217 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:48.207195    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp" event={"ID":"814f7860-4ba5-4d5c-b3f4-2348e1facb74","Type":"ContainerStarted","Data":"0a679f91b11057c8ce53bdc89690a363e575a6bb507413cce46295da8c2e1929"}
Jul 10 20:44:49.214610 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:49.214585    2571 generic.go:356] "Generic (PLEG): container finished" podID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerID="6e05b086207bb6be8d55a0aa06d53498a4570f1ca3428eb138283a0f6b75f786" exitCode=0
Jul 10 20:44:49.214998 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:49.214684    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz" event={"ID":"d7e957eb-0aa6-477f-9e18-e6cf0db80416","Type":"ContainerDied","Data":"6e05b086207bb6be8d55a0aa06d53498a4570f1ca3428eb138283a0f6b75f786"}
Jul 10 20:44:50.221449 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.221363    2571 generic.go:356] "Generic (PLEG): container finished" podID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerID="8e6d4abcc1b32e9704388f8a00ea294c1d653ec68277b05638388b65d537ab04" exitCode=0
Jul 10 20:44:50.221895 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.221442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz" event={"ID":"d7e957eb-0aa6-477f-9e18-e6cf0db80416","Type":"ContainerDied","Data":"8e6d4abcc1b32e9704388f8a00ea294c1d653ec68277b05638388b65d537ab04"}
Jul 10 20:44:50.223320 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.223301    2571 generic.go:356] "Generic (PLEG): container finished" podID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerID="57cb5c5f7c70b84a59648eb0226dab919fde1b6914f0e836b96a547ac7c8edc9" exitCode=0
Jul 10 20:44:50.223403 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.223384    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl" event={"ID":"11e4f520-0a5e-459b-bf4d-2ff48a28d73c","Type":"ContainerDied","Data":"57cb5c5f7c70b84a59648eb0226dab919fde1b6914f0e836b96a547ac7c8edc9"}
Jul 10 20:44:50.225200 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.225182    2571 generic.go:356] "Generic (PLEG): container finished" podID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerID="1691c3f5e14ab2276027f55118dab52d899850f030bd63b021c96a0b162699a6" exitCode=0
Jul 10 20:44:50.225292 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.225248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h" event={"ID":"8704a693-1329-4d73-a9c1-2c46b9d2361d","Type":"ContainerDied","Data":"1691c3f5e14ab2276027f55118dab52d899850f030bd63b021c96a0b162699a6"}
Jul 10 20:44:50.227222 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.227204    2571 generic.go:356] "Generic (PLEG): container finished" podID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerID="b96abf3aded9c55bc8f75898050f30a9430d9a13ef147e7ebc5e65bdca744ea9" exitCode=0
Jul 10 20:44:50.227312 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:50.227288    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp" event={"ID":"814f7860-4ba5-4d5c-b3f4-2348e1facb74","Type":"ContainerDied","Data":"b96abf3aded9c55bc8f75898050f30a9430d9a13ef147e7ebc5e65bdca744ea9"}
Jul 10 20:44:51.233627 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.233587    2571 generic.go:356] "Generic (PLEG): container finished" podID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerID="e50eef8cca8c72e87c808437de306fb3cf282bfeea3326f09d8f67ea68d78a54" exitCode=0
Jul 10 20:44:51.234092 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.233641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz" event={"ID":"d7e957eb-0aa6-477f-9e18-e6cf0db80416","Type":"ContainerDied","Data":"e50eef8cca8c72e87c808437de306fb3cf282bfeea3326f09d8f67ea68d78a54"}
Jul 10 20:44:51.235625 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.235603    2571 generic.go:356] "Generic (PLEG): container finished" podID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerID="bfab8a4fe32652eeae5ec39f78efd050f58face47fdd50b44103493192de1a4c" exitCode=0
Jul 10 20:44:51.235751 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.235682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl" event={"ID":"11e4f520-0a5e-459b-bf4d-2ff48a28d73c","Type":"ContainerDied","Data":"bfab8a4fe32652eeae5ec39f78efd050f58face47fdd50b44103493192de1a4c"}
Jul 10 20:44:51.237685 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.237649    2571 generic.go:356] "Generic (PLEG): container finished" podID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerID="9d28bf78dbce78dfac01d7d15b0ece38843bd445f5f5d6886d2ea4144cbe1404" exitCode=0
Jul 10 20:44:51.237685 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.237678    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h" event={"ID":"8704a693-1329-4d73-a9c1-2c46b9d2361d","Type":"ContainerDied","Data":"9d28bf78dbce78dfac01d7d15b0ece38843bd445f5f5d6886d2ea4144cbe1404"}
Jul 10 20:44:51.239671 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.239634    2571 generic.go:356] "Generic (PLEG): container finished" podID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerID="5876a51225a896d9696a96a41a518a8dfca516a011ff694b5f4ae8520545d3ff" exitCode=0
Jul 10 20:44:51.239753 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:51.239713    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp" event={"ID":"814f7860-4ba5-4d5c-b3f4-2348e1facb74","Type":"ContainerDied","Data":"5876a51225a896d9696a96a41a518a8dfca516a011ff694b5f4ae8520545d3ff"}
Jul 10 20:44:52.445558 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.445528    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:52.447786 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.447765    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:44:52.463959 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.463936    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:52.467079 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.467061    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:52.493864 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.493842    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-util\") pod \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") "
Jul 10 20:44:52.493963 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.493880    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-util\") pod \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") "
Jul 10 20:44:52.493963 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.493904    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-bundle\") pod \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") "
Jul 10 20:44:52.493963 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.493932    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-bundle\") pod \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") "
Jul 10 20:44:52.493963 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.493949    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-bundle\") pod \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.493976    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-952n9\" (UniqueName: \"kubernetes.io/projected/814f7860-4ba5-4d5c-b3f4-2348e1facb74-kube-api-access-952n9\") pod \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\" (UID: \"814f7860-4ba5-4d5c-b3f4-2348e1facb74\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494013    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-util\") pod \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494039    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsl26\" (UniqueName: \"kubernetes.io/projected/d7e957eb-0aa6-477f-9e18-e6cf0db80416-kube-api-access-vsl26\") pod \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\" (UID: \"d7e957eb-0aa6-477f-9e18-e6cf0db80416\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494083    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-util\") pod \"8704a693-1329-4d73-a9c1-2c46b9d2361d\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494112    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-bundle\") pod \"8704a693-1329-4d73-a9c1-2c46b9d2361d\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494136    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dckw\" (UniqueName: \"kubernetes.io/projected/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-kube-api-access-9dckw\") pod \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\" (UID: \"11e4f520-0a5e-459b-bf4d-2ff48a28d73c\") "
Jul 10 20:44:52.494211 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494199    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgcgc\" (UniqueName: \"kubernetes.io/projected/8704a693-1329-4d73-a9c1-2c46b9d2361d-kube-api-access-kgcgc\") pod \"8704a693-1329-4d73-a9c1-2c46b9d2361d\" (UID: \"8704a693-1329-4d73-a9c1-2c46b9d2361d\") "
Jul 10 20:44:52.494719 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-bundle" (OuterVolumeSpecName: "bundle") pod "d7e957eb-0aa6-477f-9e18-e6cf0db80416" (UID: "d7e957eb-0aa6-477f-9e18-e6cf0db80416"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.497402 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.494959    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-bundle" (OuterVolumeSpecName: "bundle") pod "11e4f520-0a5e-459b-bf4d-2ff48a28d73c" (UID: "11e4f520-0a5e-459b-bf4d-2ff48a28d73c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.497402 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.495415    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-bundle" (OuterVolumeSpecName: "bundle") pod "8704a693-1329-4d73-a9c1-2c46b9d2361d" (UID: "8704a693-1329-4d73-a9c1-2c46b9d2361d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.497402 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.497227    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8704a693-1329-4d73-a9c1-2c46b9d2361d-kube-api-access-kgcgc" (OuterVolumeSpecName: "kube-api-access-kgcgc") pod "8704a693-1329-4d73-a9c1-2c46b9d2361d" (UID: "8704a693-1329-4d73-a9c1-2c46b9d2361d"). InnerVolumeSpecName "kube-api-access-kgcgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:44:52.497402 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.497352    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-kube-api-access-9dckw" (OuterVolumeSpecName: "kube-api-access-9dckw") pod "11e4f520-0a5e-459b-bf4d-2ff48a28d73c" (UID: "11e4f520-0a5e-459b-bf4d-2ff48a28d73c"). InnerVolumeSpecName "kube-api-access-9dckw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:44:52.498148 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.497423    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e957eb-0aa6-477f-9e18-e6cf0db80416-kube-api-access-vsl26" (OuterVolumeSpecName: "kube-api-access-vsl26") pod "d7e957eb-0aa6-477f-9e18-e6cf0db80416" (UID: "d7e957eb-0aa6-477f-9e18-e6cf0db80416"). InnerVolumeSpecName "kube-api-access-vsl26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:44:52.498148 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.497639    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-bundle" (OuterVolumeSpecName: "bundle") pod "814f7860-4ba5-4d5c-b3f4-2348e1facb74" (UID: "814f7860-4ba5-4d5c-b3f4-2348e1facb74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.498639 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.498612    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/814f7860-4ba5-4d5c-b3f4-2348e1facb74-kube-api-access-952n9" (OuterVolumeSpecName: "kube-api-access-952n9") pod "814f7860-4ba5-4d5c-b3f4-2348e1facb74" (UID: "814f7860-4ba5-4d5c-b3f4-2348e1facb74"). InnerVolumeSpecName "kube-api-access-952n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:44:52.502603 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.502580    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-util" (OuterVolumeSpecName: "util") pod "d7e957eb-0aa6-477f-9e18-e6cf0db80416" (UID: "d7e957eb-0aa6-477f-9e18-e6cf0db80416"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.502974 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.502944    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-util" (OuterVolumeSpecName: "util") pod "814f7860-4ba5-4d5c-b3f4-2348e1facb74" (UID: "814f7860-4ba5-4d5c-b3f4-2348e1facb74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.503582 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.503539    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-util" (OuterVolumeSpecName: "util") pod "11e4f520-0a5e-459b-bf4d-2ff48a28d73c" (UID: "11e4f520-0a5e-459b-bf4d-2ff48a28d73c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.504026 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.503989    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-util" (OuterVolumeSpecName: "util") pod "8704a693-1329-4d73-a9c1-2c46b9d2361d" (UID: "8704a693-1329-4d73-a9c1-2c46b9d2361d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 20:44:52.595393 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595361    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595393 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595388    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dckw\" (UniqueName: \"kubernetes.io/projected/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-kube-api-access-9dckw\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595393 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595400    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgcgc\" (UniqueName: \"kubernetes.io/projected/8704a693-1329-4d73-a9c1-2c46b9d2361d-kube-api-access-kgcgc\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595411    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595419    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595426    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/814f7860-4ba5-4d5c-b3f4-2348e1facb74-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595435    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595442    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7e957eb-0aa6-477f-9e18-e6cf0db80416-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595449    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-952n9\" (UniqueName: \"kubernetes.io/projected/814f7860-4ba5-4d5c-b3f4-2348e1facb74-kube-api-access-952n9\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595457    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e4f520-0a5e-459b-bf4d-2ff48a28d73c-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595466    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsl26\" (UniqueName: \"kubernetes.io/projected/d7e957eb-0aa6-477f-9e18-e6cf0db80416-kube-api-access-vsl26\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:52.595624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:52.595473    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8704a693-1329-4d73-a9c1-2c46b9d2361d-util\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:44:53.251492 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.251462    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h"
Jul 10 20:44:53.251641 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.251463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h" event={"ID":"8704a693-1329-4d73-a9c1-2c46b9d2361d","Type":"ContainerDied","Data":"bf6ae81c2d5a5ec8f274e7300f60370f6dbf538fa8ef06ae4a8d3dfa88cbedf8"}
Jul 10 20:44:53.251641 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.251591    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf6ae81c2d5a5ec8f274e7300f60370f6dbf538fa8ef06ae4a8d3dfa88cbedf8"
Jul 10 20:44:53.253348 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.253326    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp"
Jul 10 20:44:53.253348 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.253358    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp" event={"ID":"814f7860-4ba5-4d5c-b3f4-2348e1facb74","Type":"ContainerDied","Data":"0a679f91b11057c8ce53bdc89690a363e575a6bb507413cce46295da8c2e1929"}
Jul 10 20:44:53.253645 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.253398    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a679f91b11057c8ce53bdc89690a363e575a6bb507413cce46295da8c2e1929"
Jul 10 20:44:53.255576 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.255551    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz" event={"ID":"d7e957eb-0aa6-477f-9e18-e6cf0db80416","Type":"ContainerDied","Data":"0cc35bd2332230299b89e6d3249b0871259c4f68ccf2bc169810bfbe85df50fc"}
Jul 10 20:44:53.255719 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.255590    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cc35bd2332230299b89e6d3249b0871259c4f68ccf2bc169810bfbe85df50fc"
Jul 10 20:44:53.255719 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.255648    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz"
Jul 10 20:44:53.257504 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.257481    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl" event={"ID":"11e4f520-0a5e-459b-bf4d-2ff48a28d73c","Type":"ContainerDied","Data":"93f7d20e41ed59a5f2f96e13b3f6059adde153144d24afef9fb44aa6bd16aacd"}
Jul 10 20:44:53.257646 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.257519    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93f7d20e41ed59a5f2f96e13b3f6059adde153144d24afef9fb44aa6bd16aacd"
Jul 10 20:44:53.257646 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:44:53.257584    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl"
Jul 10 20:46:10.569117 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569082    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54bc4d8d45-rdxx7"]
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569386    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569396    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569406    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569411    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569419    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569424    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569431    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569437    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569444    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569449    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569459    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569464    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569470    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569475    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569481    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569485    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569490    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569495    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569503    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569507    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="util"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569513    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569519    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="pull"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569525    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569529    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569585    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8704a693-1329-4d73-a9c1-2c46b9d2361d" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569594    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e957eb-0aa6-477f-9e18-e6cf0db80416" containerName="extract"
Jul 10 20:46:10.569594 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569603    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="11e4f520-0a5e-459b-bf4d-2ff48a28d73c" containerName="extract"
Jul 10 20:46:10.570468 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.569611    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="814f7860-4ba5-4d5c-b3f4-2348e1facb74" containerName="extract"
Jul 10 20:46:10.572568 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.572553    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.589338 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.589313    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bc4d8d45-rdxx7"]
Jul 10 20:46:10.648826 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.648798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-console-config\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.648826 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.648830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-trusted-ca-bundle\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.648989 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.648860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25e55eb-e503-407e-b254-6fdfd9e84527-console-serving-cert\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.648989 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.648910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-service-ca\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.648989 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.648932    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-oauth-serving-cert\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.648989 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.648957    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sntmv\" (UniqueName: \"kubernetes.io/projected/a25e55eb-e503-407e-b254-6fdfd9e84527-kube-api-access-sntmv\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.649115 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.649012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25e55eb-e503-407e-b254-6fdfd9e84527-console-oauth-config\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749472 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-console-config\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749472 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-trusted-ca-bundle\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749770 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25e55eb-e503-407e-b254-6fdfd9e84527-console-serving-cert\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749770 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-service-ca\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749770 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-oauth-serving-cert\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749770 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749576    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sntmv\" (UniqueName: \"kubernetes.io/projected/a25e55eb-e503-407e-b254-6fdfd9e84527-kube-api-access-sntmv\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.749770 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.749628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25e55eb-e503-407e-b254-6fdfd9e84527-console-oauth-config\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.750387 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.750358    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-console-config\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.750524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.750360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-service-ca\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.750524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.750472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-oauth-serving-cert\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.750750 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.750730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a25e55eb-e503-407e-b254-6fdfd9e84527-trusted-ca-bundle\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.752161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.752132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a25e55eb-e503-407e-b254-6fdfd9e84527-console-serving-cert\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.752161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.752155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a25e55eb-e503-407e-b254-6fdfd9e84527-console-oauth-config\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.759964 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.759934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sntmv\" (UniqueName: \"kubernetes.io/projected/a25e55eb-e503-407e-b254-6fdfd9e84527-kube-api-access-sntmv\") pod \"console-54bc4d8d45-rdxx7\" (UID: \"a25e55eb-e503-407e-b254-6fdfd9e84527\") " pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:10.882269 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:10.882175    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:11.030975 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:11.030949    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54bc4d8d45-rdxx7"]
Jul 10 20:46:11.032939 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:46:11.032914    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda25e55eb_e503_407e_b254_6fdfd9e84527.slice/crio-595784d0c2196567991f325c6ca7073c17698eecd70eebec8bf9e2a038b342b0 WatchSource:0}: Error finding container 595784d0c2196567991f325c6ca7073c17698eecd70eebec8bf9e2a038b342b0: Status 404 returned error can't find the container with id 595784d0c2196567991f325c6ca7073c17698eecd70eebec8bf9e2a038b342b0
Jul 10 20:46:11.651178 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:11.651142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bc4d8d45-rdxx7" event={"ID":"a25e55eb-e503-407e-b254-6fdfd9e84527","Type":"ContainerStarted","Data":"08e0a10ba78008b2451aa333de5b937fa06ebcde1999cf804db8f5aae521d073"}
Jul 10 20:46:11.651588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:11.651192    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54bc4d8d45-rdxx7" event={"ID":"a25e55eb-e503-407e-b254-6fdfd9e84527","Type":"ContainerStarted","Data":"595784d0c2196567991f325c6ca7073c17698eecd70eebec8bf9e2a038b342b0"}
Jul 10 20:46:11.671241 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:11.671184    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54bc4d8d45-rdxx7" podStartSLOduration=1.671168988 podStartE2EDuration="1.671168988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:46:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:46:11.669037701 +0000 UTC m=+697.509758455" watchObservedRunningTime="2026-07-10 20:46:11.671168988 +0000 UTC m=+697.511889740"
Jul 10 20:46:12.966714 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.966680    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:46:12.970082 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.970064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:12.973009 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.972985    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 20:46:12.973511 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.973493    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 20:46:12.973611 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.973511    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vbv2p\""
Jul 10 20:46:12.973611 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.973511    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 20:46:12.981775 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:12.981753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:46:13.022727 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.022699    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:46:13.070697 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.070639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzpf8\" (UniqueName: \"kubernetes.io/projected/8e2d4bf4-e03e-4225-ba64-f6905905255f-kube-api-access-xzpf8\") pod \"limitador-limitador-54d6d988d5-fbjzf\" (UID: \"8e2d4bf4-e03e-4225-ba64-f6905905255f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.070862 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.070755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e2d4bf4-e03e-4225-ba64-f6905905255f-config-file\") pod \"limitador-limitador-54d6d988d5-fbjzf\" (UID: \"8e2d4bf4-e03e-4225-ba64-f6905905255f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.171526 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.171494    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e2d4bf4-e03e-4225-ba64-f6905905255f-config-file\") pod \"limitador-limitador-54d6d988d5-fbjzf\" (UID: \"8e2d4bf4-e03e-4225-ba64-f6905905255f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.171731 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.171544    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzpf8\" (UniqueName: \"kubernetes.io/projected/8e2d4bf4-e03e-4225-ba64-f6905905255f-kube-api-access-xzpf8\") pod \"limitador-limitador-54d6d988d5-fbjzf\" (UID: \"8e2d4bf4-e03e-4225-ba64-f6905905255f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.172187 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.172161    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e2d4bf4-e03e-4225-ba64-f6905905255f-config-file\") pod \"limitador-limitador-54d6d988d5-fbjzf\" (UID: \"8e2d4bf4-e03e-4225-ba64-f6905905255f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.181617 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.181594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzpf8\" (UniqueName: \"kubernetes.io/projected/8e2d4bf4-e03e-4225-ba64-f6905905255f-kube-api-access-xzpf8\") pod \"limitador-limitador-54d6d988d5-fbjzf\" (UID: \"8e2d4bf4-e03e-4225-ba64-f6905905255f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.281771 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.281691    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:13.414107 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.414086    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:46:13.416382 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:46:13.416348    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2d4bf4_e03e_4225_ba64_f6905905255f.slice/crio-6dc941ca71e7c2609987b74b291803764f772680cdbd15ff4985b579a744c6cd WatchSource:0}: Error finding container 6dc941ca71e7c2609987b74b291803764f772680cdbd15ff4985b579a744c6cd: Status 404 returned error can't find the container with id 6dc941ca71e7c2609987b74b291803764f772680cdbd15ff4985b579a744c6cd
Jul 10 20:46:13.628277 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.628241    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wstmz"]
Jul 10 20:46:13.632684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.632649    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:13.635573 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.635551    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pkph9\""
Jul 10 20:46:13.645700 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.645680    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wstmz"]
Jul 10 20:46:13.664147 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.664120    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf" event={"ID":"8e2d4bf4-e03e-4225-ba64-f6905905255f","Type":"ContainerStarted","Data":"6dc941ca71e7c2609987b74b291803764f772680cdbd15ff4985b579a744c6cd"}
Jul 10 20:46:13.776758 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.776717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbq6f\" (UniqueName: \"kubernetes.io/projected/0539b13a-d118-4979-99a6-07ec448d23a2-kube-api-access-fbq6f\") pod \"authorino-75d556bd77-wstmz\" (UID: \"0539b13a-d118-4979-99a6-07ec448d23a2\") " pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:13.877859 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.877826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbq6f\" (UniqueName: \"kubernetes.io/projected/0539b13a-d118-4979-99a6-07ec448d23a2-kube-api-access-fbq6f\") pod \"authorino-75d556bd77-wstmz\" (UID: \"0539b13a-d118-4979-99a6-07ec448d23a2\") " pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:13.888004 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.887932    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbq6f\" (UniqueName: \"kubernetes.io/projected/0539b13a-d118-4979-99a6-07ec448d23a2-kube-api-access-fbq6f\") pod \"authorino-75d556bd77-wstmz\" (UID: \"0539b13a-d118-4979-99a6-07ec448d23a2\") " pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:13.942046 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:13.941840    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:14.119196 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:14.118421    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wstmz"]
Jul 10 20:46:14.123730 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:46:14.123207    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0539b13a_d118_4979_99a6_07ec448d23a2.slice/crio-8063b1cdcd19890f933d6b6da6f0af0663bc0fa04ed08007f11f2e7c37d842c2 WatchSource:0}: Error finding container 8063b1cdcd19890f933d6b6da6f0af0663bc0fa04ed08007f11f2e7c37d842c2: Status 404 returned error can't find the container with id 8063b1cdcd19890f933d6b6da6f0af0663bc0fa04ed08007f11f2e7c37d842c2
Jul 10 20:46:14.671756 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:14.671720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wstmz" event={"ID":"0539b13a-d118-4979-99a6-07ec448d23a2","Type":"ContainerStarted","Data":"8063b1cdcd19890f933d6b6da6f0af0663bc0fa04ed08007f11f2e7c37d842c2"}
Jul 10 20:46:16.690762 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:16.690725    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:16.691351 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:16.690781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf" event={"ID":"8e2d4bf4-e03e-4225-ba64-f6905905255f","Type":"ContainerStarted","Data":"f88bb1eaf5ea195a483aa497ea4277034ce8c782787a94d4ba10c3a9ec3f8138"}
Jul 10 20:46:16.735630 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:16.735576    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf" podStartSLOduration=2.12781466 podStartE2EDuration="4.73555529s" totalImagesPullingTime="2.60774063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:46:16.734838128 +0000 UTC m=+702.575558882" watchObservedRunningTime="2026-07-10 20:46:16.73555529 +0000 UTC m=+702.576276043"
Jul 10 20:46:18.700204 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:18.700099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wstmz" event={"ID":"0539b13a-d118-4979-99a6-07ec448d23a2","Type":"ContainerStarted","Data":"b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f"}
Jul 10 20:46:18.730904 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:18.730849    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wstmz" podStartSLOduration=1.521022909 podStartE2EDuration="5.730834291s" totalImagesPullingTime="4.209811382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:46:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:46:18.729892153 +0000 UTC m=+704.570612906" watchObservedRunningTime="2026-07-10 20:46:18.730834291 +0000 UTC m=+704.571555044"
Jul 10 20:46:20.883312 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:20.883266    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:20.883757 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:20.883338    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:20.888133 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:20.888111    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:21.720790 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:21.720760    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54bc4d8d45-rdxx7"
Jul 10 20:46:21.828971 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:21.828941    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594dcccc88-cqzzd"]
Jul 10 20:46:27.695411 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:27.695331    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"
Jul 10 20:46:46.849236 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:46.849174    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-594dcccc88-cqzzd" podUID="d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" containerName="console" containerID="cri-o://d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1" gracePeriod=15
Jul 10 20:46:47.022711 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.022679    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbqqq"]
Jul 10 20:46:47.028225 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.028203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:47.040832 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.040795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbqqq"]
Jul 10 20:46:47.098651 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.098624    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:46:47.159717 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159611    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-oauth-config\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.159717 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159690    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-oauth-serving-cert\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.159917 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159739    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-serving-cert\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.159917 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159770    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-trusted-ca-bundle\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.159917 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159824    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-service-ca\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.159917 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-config\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.159917 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.159882    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnbz5\" (UniqueName: \"kubernetes.io/projected/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-kube-api-access-cnbz5\") pod \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\" (UID: \"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5\") "
Jul 10 20:46:47.160176 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.160042    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4m2z\" (UniqueName: \"kubernetes.io/projected/8d44a27e-9db4-4276-becb-ba15de22680d-kube-api-access-x4m2z\") pod \"authorino-5d4b67c446-rbqqq\" (UID: \"8d44a27e-9db4-4276-becb-ba15de22680d\") " pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:47.160176 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.160152    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:46:47.160283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.160200    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:46:47.160283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.160214    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:46:47.160283 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.160258    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-config" (OuterVolumeSpecName: "console-config") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 20:46:47.161889 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.161863    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:46:47.162061 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.162041    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:46:47.162061 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.162048    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-kube-api-access-cnbz5" (OuterVolumeSpecName: "kube-api-access-cnbz5") pod "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" (UID: "d5a2eb09-c19a-44e8-98af-4d51c62cfaf5"). InnerVolumeSpecName "kube-api-access-cnbz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:46:47.260868 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.260839    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbqqq"]
Jul 10 20:46:47.260868 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.260856    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4m2z\" (UniqueName: \"kubernetes.io/projected/8d44a27e-9db4-4276-becb-ba15de22680d-kube-api-access-x4m2z\") pod \"authorino-5d4b67c446-rbqqq\" (UID: \"8d44a27e-9db4-4276-becb-ba15de22680d\") " pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:47.261065 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261024    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-oauth-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.261065 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:46:47.261041    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x4m2z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-rbqqq" podUID="8d44a27e-9db4-4276-becb-ba15de22680d"
Jul 10 20:46:47.261161 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261146    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-oauth-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.261197 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261166    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-serving-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.261197 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261175    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-trusted-ca-bundle\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.261197 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261184    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-service-ca\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.261304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261197    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-console-config\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.261304 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.261209    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnbz5\" (UniqueName: \"kubernetes.io/projected/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5-kube-api-access-cnbz5\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:47.276492 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.276472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4m2z\" (UniqueName: \"kubernetes.io/projected/8d44a27e-9db4-4276-becb-ba15de22680d-kube-api-access-x4m2z\") pod \"authorino-5d4b67c446-rbqqq\" (UID: \"8d44a27e-9db4-4276-becb-ba15de22680d\") " pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:47.317673 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.317638    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-777d7966bb-7cfsb"]
Jul 10 20:46:47.317979 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.317965    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" containerName="console"
Jul 10 20:46:47.318072 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.317980    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" containerName="console"
Jul 10 20:46:47.318072 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.318052    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" containerName="console"
Jul 10 20:46:47.320460 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.320445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:47.336318 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.336291    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-777d7966bb-7cfsb"]
Jul 10 20:46:47.463006 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.462915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56zpm\" (UniqueName: \"kubernetes.io/projected/b90491ce-70ef-4efb-a1a1-147f142e1ef2-kube-api-access-56zpm\") pod \"authorino-777d7966bb-7cfsb\" (UID: \"b90491ce-70ef-4efb-a1a1-147f142e1ef2\") " pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:47.466876 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.466851    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-777d7966bb-7cfsb"]
Jul 10 20:46:47.467107 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:46:47.467085    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-56zpm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-777d7966bb-7cfsb" podUID="b90491ce-70ef-4efb-a1a1-147f142e1ef2"
Jul 10 20:46:47.507127 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.507102    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d9f97f978-854pm"]
Jul 10 20:46:47.509588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.509573    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.512506 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.512488    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 20:46:47.521401 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.521381    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9f97f978-854pm"]
Jul 10 20:46:47.563544 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.563513    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56zpm\" (UniqueName: \"kubernetes.io/projected/b90491ce-70ef-4efb-a1a1-147f142e1ef2-kube-api-access-56zpm\") pod \"authorino-777d7966bb-7cfsb\" (UID: \"b90491ce-70ef-4efb-a1a1-147f142e1ef2\") " pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:47.563702 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.563552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9h2p\" (UniqueName: \"kubernetes.io/projected/b84d958b-044c-4f6f-bd07-159688dad6e7-kube-api-access-q9h2p\") pod \"authorino-d9f97f978-854pm\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") " pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.563702 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.563670    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84d958b-044c-4f6f-bd07-159688dad6e7-tls-cert\") pod \"authorino-d9f97f978-854pm\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") " pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.576110 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.576089    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56zpm\" (UniqueName: \"kubernetes.io/projected/b90491ce-70ef-4efb-a1a1-147f142e1ef2-kube-api-access-56zpm\") pod \"authorino-777d7966bb-7cfsb\" (UID: \"b90491ce-70ef-4efb-a1a1-147f142e1ef2\") " pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:47.664827 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.664793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9h2p\" (UniqueName: \"kubernetes.io/projected/b84d958b-044c-4f6f-bd07-159688dad6e7-kube-api-access-q9h2p\") pod \"authorino-d9f97f978-854pm\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") " pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.664944 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.664851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84d958b-044c-4f6f-bd07-159688dad6e7-tls-cert\") pod \"authorino-d9f97f978-854pm\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") " pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.667192 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.667172    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84d958b-044c-4f6f-bd07-159688dad6e7-tls-cert\") pod \"authorino-d9f97f978-854pm\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") " pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.675938 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.675918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9h2p\" (UniqueName: \"kubernetes.io/projected/b84d958b-044c-4f6f-bd07-159688dad6e7-kube-api-access-q9h2p\") pod \"authorino-d9f97f978-854pm\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") " pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.818355 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.818304    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:46:47.856588 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.856555    2571 generic.go:356] "Generic (PLEG): container finished" podID="d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" containerID="d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1" exitCode=0
Jul 10 20:46:47.856978 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.856608    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594dcccc88-cqzzd"
Jul 10 20:46:47.856978 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.856638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594dcccc88-cqzzd" event={"ID":"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5","Type":"ContainerDied","Data":"d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1"}
Jul 10 20:46:47.856978 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.856700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594dcccc88-cqzzd" event={"ID":"d5a2eb09-c19a-44e8-98af-4d51c62cfaf5","Type":"ContainerDied","Data":"fbe3648c1767c1c0d9ddb74517d99dd9f9f4d2c095dba1c9b511f65287059fcf"}
Jul 10 20:46:47.856978 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.856721    2571 scope.go:117] "RemoveContainer" containerID="d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1"
Jul 10 20:46:47.856978 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.856741    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:47.857208 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.857004    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:47.882162 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.882136    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:47.886437 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.886415    2571 scope.go:117] "RemoveContainer" containerID="d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1"
Jul 10 20:46:47.886857 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:46:47.886822    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1\": container with ID starting with d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1 not found: ID does not exist" containerID="d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1"
Jul 10 20:46:47.886968 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.886860    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1"} err="failed to get container status \"d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1\": rpc error: code = NotFound desc = could not find container \"d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1\": container with ID starting with d1d7b4b8f9ee332bf143ccb22b923136636aa4bc3898ab71aa0855829cfd47e1 not found: ID does not exist"
Jul 10 20:46:47.888903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.888885    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:47.926952 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.926907    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594dcccc88-cqzzd"]
Jul 10 20:46:47.929159 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.929139    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594dcccc88-cqzzd"]
Jul 10 20:46:47.959034 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.959016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9f97f978-854pm"]
Jul 10 20:46:47.961181 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:46:47.961160    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb84d958b_044c_4f6f_bd07_159688dad6e7.slice/crio-c37d25c05f062fd50c002d2342e6ff521585a55c4fbab07d1b9945302b1ca788 WatchSource:0}: Error finding container c37d25c05f062fd50c002d2342e6ff521585a55c4fbab07d1b9945302b1ca788: Status 404 returned error can't find the container with id c37d25c05f062fd50c002d2342e6ff521585a55c4fbab07d1b9945302b1ca788
Jul 10 20:46:47.968123 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.968099    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4m2z\" (UniqueName: \"kubernetes.io/projected/8d44a27e-9db4-4276-becb-ba15de22680d-kube-api-access-x4m2z\") pod \"8d44a27e-9db4-4276-becb-ba15de22680d\" (UID: \"8d44a27e-9db4-4276-becb-ba15de22680d\") "
Jul 10 20:46:47.968206 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.968157    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56zpm\" (UniqueName: \"kubernetes.io/projected/b90491ce-70ef-4efb-a1a1-147f142e1ef2-kube-api-access-56zpm\") pod \"b90491ce-70ef-4efb-a1a1-147f142e1ef2\" (UID: \"b90491ce-70ef-4efb-a1a1-147f142e1ef2\") "
Jul 10 20:46:47.970229 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.970205    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d44a27e-9db4-4276-becb-ba15de22680d-kube-api-access-x4m2z" (OuterVolumeSpecName: "kube-api-access-x4m2z") pod "8d44a27e-9db4-4276-becb-ba15de22680d" (UID: "8d44a27e-9db4-4276-becb-ba15de22680d"). InnerVolumeSpecName "kube-api-access-x4m2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:46:47.970325 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:47.970230    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b90491ce-70ef-4efb-a1a1-147f142e1ef2-kube-api-access-56zpm" (OuterVolumeSpecName: "kube-api-access-56zpm") pod "b90491ce-70ef-4efb-a1a1-147f142e1ef2" (UID: "b90491ce-70ef-4efb-a1a1-147f142e1ef2"). InnerVolumeSpecName "kube-api-access-56zpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:46:48.069217 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.069151    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4m2z\" (UniqueName: \"kubernetes.io/projected/8d44a27e-9db4-4276-becb-ba15de22680d-kube-api-access-x4m2z\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:48.069217 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.069175    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56zpm\" (UniqueName: \"kubernetes.io/projected/b90491ce-70ef-4efb-a1a1-147f142e1ef2-kube-api-access-56zpm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:48.688903 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.688867    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5a2eb09-c19a-44e8-98af-4d51c62cfaf5" path="/var/lib/kubelet/pods/d5a2eb09-c19a-44e8-98af-4d51c62cfaf5/volumes"
Jul 10 20:46:48.863739 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.863699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9f97f978-854pm" event={"ID":"b84d958b-044c-4f6f-bd07-159688dad6e7","Type":"ContainerStarted","Data":"f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c"}
Jul 10 20:46:48.864173 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.863759    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9f97f978-854pm" event={"ID":"b84d958b-044c-4f6f-bd07-159688dad6e7","Type":"ContainerStarted","Data":"c37d25c05f062fd50c002d2342e6ff521585a55c4fbab07d1b9945302b1ca788"}
Jul 10 20:46:48.864794 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.864773    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbqqq"
Jul 10 20:46:48.864899 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.864797    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-777d7966bb-7cfsb"
Jul 10 20:46:48.884543 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.884493    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d9f97f978-854pm" podStartSLOduration=1.597925826 podStartE2EDuration="1.88447998s" totalImagesPullingTime="286.554154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:46:48.882356799 +0000 UTC m=+734.723077551" watchObservedRunningTime="2026-07-10 20:46:48.88447998 +0000 UTC m=+734.725200732"
Jul 10 20:46:48.915374 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.915339    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-777d7966bb-7cfsb"]
Jul 10 20:46:48.925155 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.925097    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wstmz"]
Jul 10 20:46:48.925798 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.925754    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wstmz" podUID="0539b13a-d118-4979-99a6-07ec448d23a2" containerName="authorino" containerID="cri-o://b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f" gracePeriod=30
Jul 10 20:46:48.925991 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.925968    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-777d7966bb-7cfsb"]
Jul 10 20:46:48.955011 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.954985    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbqqq"]
Jul 10 20:46:48.960818 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:48.960790    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbqqq"]
Jul 10 20:46:49.166804 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.166781    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:49.278731 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.278611    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbq6f\" (UniqueName: \"kubernetes.io/projected/0539b13a-d118-4979-99a6-07ec448d23a2-kube-api-access-fbq6f\") pod \"0539b13a-d118-4979-99a6-07ec448d23a2\" (UID: \"0539b13a-d118-4979-99a6-07ec448d23a2\") "
Jul 10 20:46:49.280685 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.280646    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0539b13a-d118-4979-99a6-07ec448d23a2-kube-api-access-fbq6f" (OuterVolumeSpecName: "kube-api-access-fbq6f") pod "0539b13a-d118-4979-99a6-07ec448d23a2" (UID: "0539b13a-d118-4979-99a6-07ec448d23a2"). InnerVolumeSpecName "kube-api-access-fbq6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:46:49.380068 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.380021    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbq6f\" (UniqueName: \"kubernetes.io/projected/0539b13a-d118-4979-99a6-07ec448d23a2-kube-api-access-fbq6f\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:46:49.871261 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.871229    2571 generic.go:356] "Generic (PLEG): container finished" podID="0539b13a-d118-4979-99a6-07ec448d23a2" containerID="b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f" exitCode=0
Jul 10 20:46:49.871703 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.871272    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wstmz"
Jul 10 20:46:49.871703 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.871318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wstmz" event={"ID":"0539b13a-d118-4979-99a6-07ec448d23a2","Type":"ContainerDied","Data":"b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f"}
Jul 10 20:46:49.871703 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.871360    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wstmz" event={"ID":"0539b13a-d118-4979-99a6-07ec448d23a2","Type":"ContainerDied","Data":"8063b1cdcd19890f933d6b6da6f0af0663bc0fa04ed08007f11f2e7c37d842c2"}
Jul 10 20:46:49.871703 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.871382    2571 scope.go:117] "RemoveContainer" containerID="b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f"
Jul 10 20:46:49.880072 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.880050    2571 scope.go:117] "RemoveContainer" containerID="b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f"
Jul 10 20:46:49.880324 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:46:49.880306    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f\": container with ID starting with b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f not found: ID does not exist" containerID="b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f"
Jul 10 20:46:49.880397 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.880331    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f"} err="failed to get container status \"b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f\": rpc error: code = NotFound desc = could not find container \"b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f\": container with ID starting with b5758e2c38105b317051c596495bf4e6e49b76ccede50b6eedc52d1bcecce32f not found: ID does not exist"
Jul 10 20:46:49.894159 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.894136    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wstmz"]
Jul 10 20:46:49.898101 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:49.898080    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wstmz"]
Jul 10 20:46:50.688842 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:50.688803    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0539b13a-d118-4979-99a6-07ec448d23a2" path="/var/lib/kubelet/pods/0539b13a-d118-4979-99a6-07ec448d23a2/volumes"
Jul 10 20:46:50.689234 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:50.689214    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d44a27e-9db4-4276-becb-ba15de22680d" path="/var/lib/kubelet/pods/8d44a27e-9db4-4276-becb-ba15de22680d/volumes"
Jul 10 20:46:50.689460 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:46:50.689443    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b90491ce-70ef-4efb-a1a1-147f142e1ef2" path="/var/lib/kubelet/pods/b90491ce-70ef-4efb-a1a1-147f142e1ef2/volumes"
Jul 10 20:47:31.546189 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:47:31.546152    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:47:52.942583 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:47:52.942549    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:48:03.339351 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:03.339317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:48:09.636610 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:09.636566    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:48:13.327317 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.327271    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"]
Jul 10 20:48:13.327718 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.327623    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0539b13a-d118-4979-99a6-07ec448d23a2" containerName="authorino"
Jul 10 20:48:13.327718 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.327634    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0539b13a-d118-4979-99a6-07ec448d23a2" containerName="authorino"
Jul 10 20:48:13.327801 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.327722    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0539b13a-d118-4979-99a6-07ec448d23a2" containerName="authorino"
Jul 10 20:48:13.330748 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.330732    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.333614 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.333593    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 20:48:13.334740 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.334720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 10 20:48:13.334848 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.334740    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 20:48:13.334848 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.334741    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-szg4s\""
Jul 10 20:48:13.341935 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.341913    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"]
Jul 10 20:48:13.475438 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.475405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e44530-bb00-4b5d-97f7-8f969b55df01-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.475638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.475466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnnlx\" (UniqueName: \"kubernetes.io/projected/b7e44530-bb00-4b5d-97f7-8f969b55df01-kube-api-access-xnnlx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.475638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.475496    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.475638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.475538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.475638 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.475609    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.475846 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.475643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577041 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnnlx\" (UniqueName: \"kubernetes.io/projected/b7e44530-bb00-4b5d-97f7-8f969b55df01-kube-api-access-xnnlx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577041 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577297 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577297 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577297 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577297 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577165    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e44530-bb00-4b5d-97f7-8f969b55df01-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577582 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577582 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.577582 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.577571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.579427 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.579396    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e44530-bb00-4b5d-97f7-8f969b55df01-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.579636 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.579617    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e44530-bb00-4b5d-97f7-8f969b55df01-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.585523 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.585497    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnnlx\" (UniqueName: \"kubernetes.io/projected/b7e44530-bb00-4b5d-97f7-8f969b55df01-kube-api-access-xnnlx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk\" (UID: \"b7e44530-bb00-4b5d-97f7-8f969b55df01\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.641117 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.641086    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:13.775948 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:13.775921    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"]
Jul 10 20:48:13.778434 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:48:13.778404    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e44530_bb00_4b5d_97f7_8f969b55df01.slice/crio-b7672b2d1707be66e1505c5ce4859f3475dbecc79029806bde1c7cd4789b5c5c WatchSource:0}: Error finding container b7672b2d1707be66e1505c5ce4859f3475dbecc79029806bde1c7cd4789b5c5c: Status 404 returned error can't find the container with id b7672b2d1707be66e1505c5ce4859f3475dbecc79029806bde1c7cd4789b5c5c
Jul 10 20:48:14.308296 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:14.308175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk" event={"ID":"b7e44530-bb00-4b5d-97f7-8f969b55df01","Type":"ContainerStarted","Data":"b7672b2d1707be66e1505c5ce4859f3475dbecc79029806bde1c7cd4789b5c5c"}
Jul 10 20:48:15.289524 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:15.289441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:48:15.316350 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:15.316314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk" event={"ID":"b7e44530-bb00-4b5d-97f7-8f969b55df01","Type":"ContainerStarted","Data":"a073d2f528d37b48019553d6cf292e002a350f1fe35f0a95b2de67f8334ebe07"}
Jul 10 20:48:15.352820 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:15.352764    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk" podStartSLOduration=1.305892742 podStartE2EDuration="2.352749114s" totalImagesPullingTime="1.046856372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:48:15.352064313 +0000 UTC m=+821.192785066" watchObservedRunningTime="2026-07-10 20:48:15.352749114 +0000 UTC m=+821.193469866"
Jul 10 20:48:23.641880 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:23.641838    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:23.642271 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:23.641909    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:23.654465 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:23.654442    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:24.372247 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:24.372220    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk"
Jul 10 20:48:31.177869 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:31.177831    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:48:47.620157 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.620124    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"]
Jul 10 20:48:47.626539 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.626519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.629671 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.629634    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 20:48:47.635233 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.635211    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"]
Jul 10 20:48:47.757323 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.757291    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.757502 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.757339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186e73a5-de60-46da-8404-c595d39a6039-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.757502 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.757368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.757502 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.757448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.757680 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.757519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tfnd\" (UniqueName: \"kubernetes.io/projected/186e73a5-de60-46da-8404-c595d39a6039-kube-api-access-4tfnd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.757680 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.757550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858464 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858615 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186e73a5-de60-46da-8404-c595d39a6039-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858615 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858615 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858786 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tfnd\" (UniqueName: \"kubernetes.io/projected/186e73a5-de60-46da-8404-c595d39a6039-kube-api-access-4tfnd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858786 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858904 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.858968 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.859019 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.858960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.860764 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.860747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/186e73a5-de60-46da-8404-c595d39a6039-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.861045 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.861023    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/186e73a5-de60-46da-8404-c595d39a6039-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.867720 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.867700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tfnd\" (UniqueName: \"kubernetes.io/projected/186e73a5-de60-46da-8404-c595d39a6039-kube-api-access-4tfnd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l\" (UID: \"186e73a5-de60-46da-8404-c595d39a6039\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:47.936513 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:47.936442    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:48.070049 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:48.070025    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"]
Jul 10 20:48:48.071752 ip-10-0-139-118 kubenswrapper[2571]: W0710 20:48:48.071722    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod186e73a5_de60_46da_8404_c595d39a6039.slice/crio-6c8d83d277bab1765c0a6f34af2813e82df4e7842cffc970539098a48c26406d WatchSource:0}: Error finding container 6c8d83d277bab1765c0a6f34af2813e82df4e7842cffc970539098a48c26406d: Status 404 returned error can't find the container with id 6c8d83d277bab1765c0a6f34af2813e82df4e7842cffc970539098a48c26406d
Jul 10 20:48:48.487900 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:48.487867    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l" event={"ID":"186e73a5-de60-46da-8404-c595d39a6039","Type":"ContainerStarted","Data":"6b0cd94fede5f8de1660eadb358d3808188326b8b67c34cfa3d2e0652424ccdf"}
Jul 10 20:48:48.487900 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:48.487907    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l" event={"ID":"186e73a5-de60-46da-8404-c595d39a6039","Type":"ContainerStarted","Data":"6c8d83d277bab1765c0a6f34af2813e82df4e7842cffc970539098a48c26406d"}
Jul 10 20:48:48.505631 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:48.505573    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l" podStartSLOduration=1.31030188 podStartE2EDuration="1.505557724s" totalImagesPullingTime="195.255844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:48:48.504308275 +0000 UTC m=+854.345029027" watchObservedRunningTime="2026-07-10 20:48:48.505557724 +0000 UTC m=+854.346278454"
Jul 10 20:48:50.038140 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:50.038106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:48:57.937289 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:57.937251    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:57.937831 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:57.937303    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:57.950133 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:57.950107    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:48:58.548837 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:48:58.548804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l"
Jul 10 20:49:34.653353 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:49:34.653326    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:49:34.656944 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:49:34.656921    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:50:03.766799 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:03.766761    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d9f97f978-854pm"]
Jul 10 20:50:03.769166 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:03.766946    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-d9f97f978-854pm" podUID="b84d958b-044c-4f6f-bd07-159688dad6e7" containerName="authorino" containerID="cri-o://f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c" gracePeriod=30
Jul 10 20:50:04.015350 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.015326    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:50:04.115477 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.115441    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9h2p\" (UniqueName: \"kubernetes.io/projected/b84d958b-044c-4f6f-bd07-159688dad6e7-kube-api-access-q9h2p\") pod \"b84d958b-044c-4f6f-bd07-159688dad6e7\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") "
Jul 10 20:50:04.115646 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.115530    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84d958b-044c-4f6f-bd07-159688dad6e7-tls-cert\") pod \"b84d958b-044c-4f6f-bd07-159688dad6e7\" (UID: \"b84d958b-044c-4f6f-bd07-159688dad6e7\") "
Jul 10 20:50:04.117621 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.117594    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84d958b-044c-4f6f-bd07-159688dad6e7-kube-api-access-q9h2p" (OuterVolumeSpecName: "kube-api-access-q9h2p") pod "b84d958b-044c-4f6f-bd07-159688dad6e7" (UID: "b84d958b-044c-4f6f-bd07-159688dad6e7"). InnerVolumeSpecName "kube-api-access-q9h2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 20:50:04.125684 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.125640    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b84d958b-044c-4f6f-bd07-159688dad6e7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b84d958b-044c-4f6f-bd07-159688dad6e7" (UID: "b84d958b-044c-4f6f-bd07-159688dad6e7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 20:50:04.217067 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.217037    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9h2p\" (UniqueName: \"kubernetes.io/projected/b84d958b-044c-4f6f-bd07-159688dad6e7-kube-api-access-q9h2p\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:50:04.217067 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.217065    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b84d958b-044c-4f6f-bd07-159688dad6e7-tls-cert\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 20:50:04.883624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.883583    2571 generic.go:356] "Generic (PLEG): container finished" podID="b84d958b-044c-4f6f-bd07-159688dad6e7" containerID="f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c" exitCode=0
Jul 10 20:50:04.883624 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.883626    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9f97f978-854pm"
Jul 10 20:50:04.884169 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.883684    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9f97f978-854pm" event={"ID":"b84d958b-044c-4f6f-bd07-159688dad6e7","Type":"ContainerDied","Data":"f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c"}
Jul 10 20:50:04.884169 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.883731    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9f97f978-854pm" event={"ID":"b84d958b-044c-4f6f-bd07-159688dad6e7","Type":"ContainerDied","Data":"c37d25c05f062fd50c002d2342e6ff521585a55c4fbab07d1b9945302b1ca788"}
Jul 10 20:50:04.884169 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.883748    2571 scope.go:117] "RemoveContainer" containerID="f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c"
Jul 10 20:50:04.892874 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.892857    2571 scope.go:117] "RemoveContainer" containerID="f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c"
Jul 10 20:50:04.893146 ip-10-0-139-118 kubenswrapper[2571]: E0710 20:50:04.893121    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c\": container with ID starting with f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c not found: ID does not exist" containerID="f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c"
Jul 10 20:50:04.893204 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.893153    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c"} err="failed to get container status \"f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c\": rpc error: code = NotFound desc = could not find container \"f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c\": container with ID starting with f58009047d46a47da1c25d35c3a78266b0e0b211ed7d8690120611e59e41898c not found: ID does not exist"
Jul 10 20:50:04.904905 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.904878    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-d9f97f978-854pm"]
Jul 10 20:50:04.914239 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:04.914218    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-d9f97f978-854pm"]
Jul 10 20:50:06.689745 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:06.689716    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84d958b-044c-4f6f-bd07-159688dad6e7" path="/var/lib/kubelet/pods/b84d958b-044c-4f6f-bd07-159688dad6e7/volumes"
Jul 10 20:50:31.124356 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:31.124321    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:50:40.824386 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:40.824342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:50:52.419271 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:50:52.419224    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:51:00.424477 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:51:00.424437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:51:12.323390 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:51:12.323352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:51:37.627673 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:51:37.627623    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:51:50.827085 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:51:50.827044    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:52:24.596642 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:52:24.596608    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:52:34.326471 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:52:34.326432    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:52:44.218755 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:52:44.218703    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:52:52.719260 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:52:52.719218    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:53:04.224451 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:53:04.224415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:53:16.227259 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:53:16.227204    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:53:27.022265 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:53:27.022227    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:53:37.121608 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:53:37.121573    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:53:57.820705 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:53:57.820588    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:54:07.422254 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:54:07.422219    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:54:34.634982 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:54:34.634947    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:54:34.686169 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:54:34.686139    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:54:34.691671 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:54:34.691636    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:54:45.826553 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:54:45.826519    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:55:01.428925 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:55:01.428889    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:55:11.532188 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:55:11.532139    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:55:21.123826 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:55:21.123788    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:55:31.335375 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:55:31.335291    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:55:40.815621 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:55:40.815584    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:57:28.832226 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:57:28.832190    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:57:40.824366 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:57:40.824327    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:57:49.535300 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:57:49.535256    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:58:01.616541 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:58:01.616493    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:58:11.725251 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:58:11.725215    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:58:23.925843 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:58:23.925806    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:58:31.721599 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:58:31.721516    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:58:42.226646 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:58:42.226607    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:58:53.614158 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:58:53.614121    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:59:02.629134 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:02.629095    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:59:13.823397 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:13.823359    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:59:34.720357 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:34.720325    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:59:34.726567 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:34.726544    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 20:59:35.029083 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:35.029004    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:59:44.631561 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:44.631522    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 20:59:54.846364 ip-10-0-139-118 kubenswrapper[2571]: I0710 20:59:54.846327    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:00:04.920854 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:00:04.920820    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:00:15.281275 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:00:15.281238    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:00:27.023992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:00:27.023960    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:00:36.825997 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:00:36.825962    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:00:46.220421 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:00:46.220387    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:00:54.323637 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:00:54.323596    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:01:03.733059 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:01:03.733022    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:01:13.433015 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:01:13.432973    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:01:27.227344 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:01:27.227266    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:01:37.220291 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:01:37.220252    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:01:46.918000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:01:46.917966    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:01:59.526643 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:01:59.526602    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:02:08.923186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:02:08.923144    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:02:15.734186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:02:15.734151    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:02:32.222526 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:02:32.222492    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:02:44.523091 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:02:44.523051    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:02:54.517158 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:02:54.517117    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:03:08.324102 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:03:08.324065    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:03:17.026650 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:03:17.026615    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:03:27.027528 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:03:27.027491    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:03:43.722478 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:03:43.722441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:03:56.217605 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:03:56.217568    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:04:04.033049 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:04:04.033008    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:04:14.737417 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:04:14.737380    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:04:34.751975 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:04:34.751946    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 21:04:34.759026 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:04:34.759006    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 21:05:34.719963 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:05:34.719925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:05:43.727201 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:05:43.723908    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:05:54.926416 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:05:54.926373    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:06:05.832221 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:05.832184    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:06:36.318550 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:36.318506    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:06:55.605516 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.605479    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"]
Jul 10 21:06:55.606012 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.605971    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84d958b-044c-4f6f-bd07-159688dad6e7" containerName="authorino"
Jul 10 21:06:55.606012 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.605988    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84d958b-044c-4f6f-bd07-159688dad6e7" containerName="authorino"
Jul 10 21:06:55.606128 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.606057    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84d958b-044c-4f6f-bd07-159688dad6e7" containerName="authorino"
Jul 10 21:06:55.609043 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.609025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.611620 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.611599    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8d3029d7\"/\"openshift-service-ca.crt\""
Jul 10 21:06:55.612568 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.612547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8d3029d7\"/\"default-dockercfg-4vmwq\""
Jul 10 21:06:55.612683 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.612576    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8d3029d7\"/\"kube-root-ca.crt\""
Jul 10 21:06:55.612683 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.612596    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8d3029d7\"/\"e2e-lifecycle-model-8d3029d7-kserve-self-signed-certs\""
Jul 10 21:06:55.620028 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.620007    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"]
Jul 10 21:06:55.670980 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.670954    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0e42dd-112a-46cc-9db3-88886780c392-tls-certs\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.671130 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.670989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-model-cache\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.671130 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.671026    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/8a0e42dd-112a-46cc-9db3-88886780c392-kube-api-access-snd6z\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.671130 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.671070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-tmp-dir\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.671130 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.671099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-home\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.671130 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.671112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-dshm\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772179 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0e42dd-112a-46cc-9db3-88886780c392-tls-certs\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772179 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-model-cache\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772441 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/8a0e42dd-112a-46cc-9db3-88886780c392-kube-api-access-snd6z\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772441 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772242    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-tmp-dir\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772441 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-home\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772441 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-dshm\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772715 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-model-cache\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772715 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-home\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.772715 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.772706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-tmp-dir\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.774531 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.774503    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-dshm\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.774794 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.774777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0e42dd-112a-46cc-9db3-88886780c392-tls-certs\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.782184 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.782160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/8a0e42dd-112a-46cc-9db3-88886780c392-kube-api-access-snd6z\") pod \"e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") " pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:55.920191 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:55.920159    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:06:56.053440 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:56.053408    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"]
Jul 10 21:06:56.054818 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:06:56.054791    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a0e42dd_112a_46cc_9db3_88886780c392.slice/crio-98ac321395bf2e695bfbb33c338eba10afcf5e3c7a96805e3942e8c70b4033c2 WatchSource:0}: Error finding container 98ac321395bf2e695bfbb33c338eba10afcf5e3c7a96805e3942e8c70b4033c2: Status 404 returned error can't find the container with id 98ac321395bf2e695bfbb33c338eba10afcf5e3c7a96805e3942e8c70b4033c2
Jul 10 21:06:56.982805 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:56.982763    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt" event={"ID":"8a0e42dd-112a-46cc-9db3-88886780c392","Type":"ContainerStarted","Data":"f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1"}
Jul 10 21:06:56.982805 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:56.982811    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt" event={"ID":"8a0e42dd-112a-46cc-9db3-88886780c392","Type":"ContainerStarted","Data":"98ac321395bf2e695bfbb33c338eba10afcf5e3c7a96805e3942e8c70b4033c2"}
Jul 10 21:06:56.998881 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:56.998828    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt" podStartSLOduration=1.9988138260000001 podStartE2EDuration="1.998813826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:06:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:06:56.99763655 +0000 UTC m=+1942.838357330" watchObservedRunningTime="2026-07-10 21:06:56.998813826 +0000 UTC m=+1942.839534578"
Jul 10 21:06:59.028878 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:06:59.028833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:07:05.921000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:05.920962    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:07:05.921405 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:05.921020    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:07:05.933792 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:05.933767    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:07:06.039150 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:06.039111    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:07:14.634541 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:14.634500    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:07:28.099164 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:28.099079    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"]
Jul 10 21:07:28.123418 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:28.123378    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:07:43.120506 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.120460    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt" podUID="8a0e42dd-112a-46cc-9db3-88886780c392" containerName="main" containerID="cri-o://f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1" gracePeriod=45
Jul 10 21:07:43.375007 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.374949    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:07:43.485796 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.485758    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-home\") pod \"8a0e42dd-112a-46cc-9db3-88886780c392\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") "
Jul 10 21:07:43.485992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.485810    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/8a0e42dd-112a-46cc-9db3-88886780c392-kube-api-access-snd6z\") pod \"8a0e42dd-112a-46cc-9db3-88886780c392\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") "
Jul 10 21:07:43.485992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.485835    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0e42dd-112a-46cc-9db3-88886780c392-tls-certs\") pod \"8a0e42dd-112a-46cc-9db3-88886780c392\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") "
Jul 10 21:07:43.485992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.485850    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-model-cache\") pod \"8a0e42dd-112a-46cc-9db3-88886780c392\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") "
Jul 10 21:07:43.485992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.485882    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-tmp-dir\") pod \"8a0e42dd-112a-46cc-9db3-88886780c392\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") "
Jul 10 21:07:43.486213 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486032    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-dshm\") pod \"8a0e42dd-112a-46cc-9db3-88886780c392\" (UID: \"8a0e42dd-112a-46cc-9db3-88886780c392\") "
Jul 10 21:07:43.486213 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486095    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-home" (OuterVolumeSpecName: "home") pod "8a0e42dd-112a-46cc-9db3-88886780c392" (UID: "8a0e42dd-112a-46cc-9db3-88886780c392"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:07:43.486213 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486174    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a0e42dd-112a-46cc-9db3-88886780c392" (UID: "8a0e42dd-112a-46cc-9db3-88886780c392"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:07:43.486213 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486182    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a0e42dd-112a-46cc-9db3-88886780c392" (UID: "8a0e42dd-112a-46cc-9db3-88886780c392"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:07:43.486459 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486369    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:07:43.486459 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486390    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:07:43.486459 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.486405    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:07:43.488226 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.488202    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a0e42dd-112a-46cc-9db3-88886780c392-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a0e42dd-112a-46cc-9db3-88886780c392" (UID: "8a0e42dd-112a-46cc-9db3-88886780c392"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:07:43.488226 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.488207    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-dshm" (OuterVolumeSpecName: "dshm") pod "8a0e42dd-112a-46cc-9db3-88886780c392" (UID: "8a0e42dd-112a-46cc-9db3-88886780c392"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:07:43.488373 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.488276    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0e42dd-112a-46cc-9db3-88886780c392-kube-api-access-snd6z" (OuterVolumeSpecName: "kube-api-access-snd6z") pod "8a0e42dd-112a-46cc-9db3-88886780c392" (UID: "8a0e42dd-112a-46cc-9db3-88886780c392"). InnerVolumeSpecName "kube-api-access-snd6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:07:43.587051 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.587018    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snd6z\" (UniqueName: \"kubernetes.io/projected/8a0e42dd-112a-46cc-9db3-88886780c392-kube-api-access-snd6z\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:07:43.587051 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.587048    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a0e42dd-112a-46cc-9db3-88886780c392-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:07:43.587051 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:43.587057    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a0e42dd-112a-46cc-9db3-88886780c392-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:07:44.220976 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.220944    2571 generic.go:356] "Generic (PLEG): container finished" podID="8a0e42dd-112a-46cc-9db3-88886780c392" containerID="f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1" exitCode=0
Jul 10 21:07:44.220976 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.220982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt" event={"ID":"8a0e42dd-112a-46cc-9db3-88886780c392","Type":"ContainerDied","Data":"f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1"}
Jul 10 21:07:44.221504 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.220986    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"
Jul 10 21:07:44.221504 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.221009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt" event={"ID":"8a0e42dd-112a-46cc-9db3-88886780c392","Type":"ContainerDied","Data":"98ac321395bf2e695bfbb33c338eba10afcf5e3c7a96805e3942e8c70b4033c2"}
Jul 10 21:07:44.221504 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.221030    2571 scope.go:117] "RemoveContainer" containerID="f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1"
Jul 10 21:07:44.230305 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.230287    2571 scope.go:117] "RemoveContainer" containerID="f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1"
Jul 10 21:07:44.230552 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:07:44.230530    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1\": container with ID starting with f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1 not found: ID does not exist" containerID="f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1"
Jul 10 21:07:44.230621 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.230560    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1"} err="failed to get container status \"f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1\": rpc error: code = NotFound desc = could not find container \"f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1\": container with ID starting with f38dcd2b9fc9a22abda36456ae54d0f249263490d893783642eab68ea58b6ce1 not found: ID does not exist"
Jul 10 21:07:44.242315 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.242293    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"]
Jul 10 21:07:44.250823 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.250801    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8d3029d7/e2e-lifecycle-model-8d3029d7-kserve-5f8cd675f5-frpkt"]
Jul 10 21:07:44.691428 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:07:44.691388    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a0e42dd-112a-46cc-9db3-88886780c392" path="/var/lib/kubelet/pods/8a0e42dd-112a-46cc-9db3-88886780c392/volumes"
Jul 10 21:08:08.113721 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:08:08.113681    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:09:12.413668 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:12.413631    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:09:29.723575 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:29.723541    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:09:30.026107 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.025976    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"]
Jul 10 21:09:30.026420 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.026401    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a0e42dd-112a-46cc-9db3-88886780c392" containerName="main"
Jul 10 21:09:30.026507 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.026423    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a0e42dd-112a-46cc-9db3-88886780c392" containerName="main"
Jul 10 21:09:30.026565 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.026519    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a0e42dd-112a-46cc-9db3-88886780c392" containerName="main"
Jul 10 21:09:30.029773 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.029703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.033511 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.033483    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7b3231\"/\"openshift-service-ca.crt\""
Jul 10 21:09:30.033647 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.033533    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7b3231\"/\"test-model-7b3231-kserve-self-signed-certs\""
Jul 10 21:09:30.033647 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.033602    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7b3231\"/\"default-dockercfg-b4rxl\""
Jul 10 21:09:30.033647 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.033537    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7b3231\"/\"kube-root-ca.crt\""
Jul 10 21:09:30.038754 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.038721    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"]
Jul 10 21:09:30.105146 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.105119    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-dshm\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.105146 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.105156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-tmp-dir\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.105341 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.105180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvc49\" (UniqueName: \"kubernetes.io/projected/5b0ce962-5762-4188-b540-beeabdf1e271-kube-api-access-cvc49\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.105341 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.105258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-model-cache\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.105341 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.105304    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0ce962-5762-4188-b540-beeabdf1e271-tls-certs\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.105442 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.105355    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-home\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.206877 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.206830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0ce962-5762-4188-b540-beeabdf1e271-tls-certs\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207062 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.206907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-home\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207062 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.206945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-dshm\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207062 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.206971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-tmp-dir\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207062 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.206997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvc49\" (UniqueName: \"kubernetes.io/projected/5b0ce962-5762-4188-b540-beeabdf1e271-kube-api-access-cvc49\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207062 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.207050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-model-cache\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207502 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.207474    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-model-cache\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207502 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.207512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-home\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.207713 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.207601    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-tmp-dir\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.209498 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.209466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0ce962-5762-4188-b540-beeabdf1e271-tls-certs\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.209498 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.209481    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-dshm\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.218375 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.218351    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvc49\" (UniqueName: \"kubernetes.io/projected/5b0ce962-5762-4188-b540-beeabdf1e271-kube-api-access-cvc49\") pod \"test-model-7b3231-kserve-864947749-chjb5\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") " pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.339933 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.339905    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:30.474650 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.474619    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"]
Jul 10 21:09:30.475916 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:09:30.475891    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b0ce962_5762_4188_b540_beeabdf1e271.slice/crio-3ee249d4917b10617402b77abb24ec5b58bbdfc90c967175be9c4387e8f4ede7 WatchSource:0}: Error finding container 3ee249d4917b10617402b77abb24ec5b58bbdfc90c967175be9c4387e8f4ede7: Status 404 returned error can't find the container with id 3ee249d4917b10617402b77abb24ec5b58bbdfc90c967175be9c4387e8f4ede7
Jul 10 21:09:30.753316 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.753217    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5" event={"ID":"5b0ce962-5762-4188-b540-beeabdf1e271","Type":"ContainerStarted","Data":"42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c"}
Jul 10 21:09:30.753316 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.753256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5" event={"ID":"5b0ce962-5762-4188-b540-beeabdf1e271","Type":"ContainerStarted","Data":"3ee249d4917b10617402b77abb24ec5b58bbdfc90c967175be9c4387e8f4ede7"}
Jul 10 21:09:30.770787 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:30.770739    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5" podStartSLOduration=0.770724195 podStartE2EDuration="770.724195ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:09:30.769430631 +0000 UTC m=+2096.610151383" watchObservedRunningTime="2026-07-10 21:09:30.770724195 +0000 UTC m=+2096.611444947"
Jul 10 21:09:34.784218 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:34.784189    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 21:09:34.793094 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:34.793070    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 21:09:40.340425 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:40.340389    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:40.340850 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:40.340652    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:40.352856 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:40.352830    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:40.814672 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:40.814629    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:09:44.429749 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:44.429710    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:09:46.018381 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.018346    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"]
Jul 10 21:09:46.021650 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.021633    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.024693 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.024645    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fc7575\"/\"openshift-service-ca.crt\""
Jul 10 21:09:46.024825 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.024678    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fc7575\"/\"kube-root-ca.crt\""
Jul 10 21:09:46.026001 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.025964    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fc7575\"/\"test-model-fc7575-kserve-self-signed-certs\""
Jul 10 21:09:46.026001 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.025978    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fc7575\"/\"default-dockercfg-8mvbz\""
Jul 10 21:09:46.030992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.030965    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"]
Jul 10 21:09:46.156835 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.156802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-home\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.157000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.156861    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-model-cache\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.157000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.156882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-dshm\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.157000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.156931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmljt\" (UniqueName: \"kubernetes.io/projected/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-kube-api-access-xmljt\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.157000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.156950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tls-certs\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.157000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.156970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tmp-dir\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.257627 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.257593    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-home\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.257808 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.257652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-model-cache\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.257808 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.257695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-dshm\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.257808 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.257739    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmljt\" (UniqueName: \"kubernetes.io/projected/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-kube-api-access-xmljt\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.257808 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.257767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tls-certs\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.257808 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.257795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tmp-dir\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.258093 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.258065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-home\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.258149 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.258097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-model-cache\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.258149 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.258140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tmp-dir\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.260000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.259974    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-dshm\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.260266 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.260248    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tls-certs\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.269995 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.269935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmljt\" (UniqueName: \"kubernetes.io/projected/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-kube-api-access-xmljt\") pod \"test-model-fc7575-kserve-dcd69fccf-f59jb\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") " pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.331942 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.331903    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:46.465874 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.465848    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"]
Jul 10 21:09:46.467409 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:09:46.467382    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2adf783_174d_4aa1_8161_4b9fd4b9f8b7.slice/crio-7bd96aa3e72654b225dab6fe2bc25563961beb66c83493bd747ed3dee5153188 WatchSource:0}: Error finding container 7bd96aa3e72654b225dab6fe2bc25563961beb66c83493bd747ed3dee5153188: Status 404 returned error can't find the container with id 7bd96aa3e72654b225dab6fe2bc25563961beb66c83493bd747ed3dee5153188
Jul 10 21:09:46.835975 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.835936    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb" event={"ID":"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7","Type":"ContainerStarted","Data":"5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190"}
Jul 10 21:09:46.835975 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.835980    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb" event={"ID":"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7","Type":"ContainerStarted","Data":"7bd96aa3e72654b225dab6fe2bc25563961beb66c83493bd747ed3dee5153188"}
Jul 10 21:09:46.854287 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:46.854241    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb" podStartSLOduration=1.8542251589999998 podStartE2EDuration="1.854225159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:09:46.852363162 +0000 UTC m=+2112.693083927" watchObservedRunningTime="2026-07-10 21:09:46.854225159 +0000 UTC m=+2112.694945909"
Jul 10 21:09:55.625878 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:55.625847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:09:56.333083 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:56.333042    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:56.333265 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:56.333109    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:56.345561 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:56.345533    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:09:56.898404 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:09:56.898376    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:10:09.633299 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:09.633259    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"]
Jul 10 21:10:10.549237 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:10.549200    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"]
Jul 10 21:10:16.328392 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:16.328355    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:10:24.653352 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.653311    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5" podUID="5b0ce962-5762-4188-b540-beeabdf1e271" containerName="main" containerID="cri-o://42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c" gracePeriod=45
Jul 10 21:10:24.901429 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.901406    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:10:24.999371 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999276    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-dshm\") pod \"5b0ce962-5762-4188-b540-beeabdf1e271\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") "
Jul 10 21:10:24.999520 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999376    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0ce962-5762-4188-b540-beeabdf1e271-tls-certs\") pod \"5b0ce962-5762-4188-b540-beeabdf1e271\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") "
Jul 10 21:10:24.999520 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999447    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvc49\" (UniqueName: \"kubernetes.io/projected/5b0ce962-5762-4188-b540-beeabdf1e271-kube-api-access-cvc49\") pod \"5b0ce962-5762-4188-b540-beeabdf1e271\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") "
Jul 10 21:10:24.999520 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999486    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-home\") pod \"5b0ce962-5762-4188-b540-beeabdf1e271\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") "
Jul 10 21:10:24.999653 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999521    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-tmp-dir\") pod \"5b0ce962-5762-4188-b540-beeabdf1e271\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") "
Jul 10 21:10:24.999653 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999555    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-model-cache\") pod \"5b0ce962-5762-4188-b540-beeabdf1e271\" (UID: \"5b0ce962-5762-4188-b540-beeabdf1e271\") "
Jul 10 21:10:24.999811 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999772    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-home" (OuterVolumeSpecName: "home") pod "5b0ce962-5762-4188-b540-beeabdf1e271" (UID: "5b0ce962-5762-4188-b540-beeabdf1e271"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:24.999931 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999908    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:24.999931 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999913    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b0ce962-5762-4188-b540-beeabdf1e271" (UID: "5b0ce962-5762-4188-b540-beeabdf1e271"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.000096 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:24.999933    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b0ce962-5762-4188-b540-beeabdf1e271" (UID: "5b0ce962-5762-4188-b540-beeabdf1e271"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.001688 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.001668    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-dshm" (OuterVolumeSpecName: "dshm") pod "5b0ce962-5762-4188-b540-beeabdf1e271" (UID: "5b0ce962-5762-4188-b540-beeabdf1e271"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.002005 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.001988    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0ce962-5762-4188-b540-beeabdf1e271-kube-api-access-cvc49" (OuterVolumeSpecName: "kube-api-access-cvc49") pod "5b0ce962-5762-4188-b540-beeabdf1e271" (UID: "5b0ce962-5762-4188-b540-beeabdf1e271"). InnerVolumeSpecName "kube-api-access-cvc49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:10:25.002046 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.002000    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b0ce962-5762-4188-b540-beeabdf1e271-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b0ce962-5762-4188-b540-beeabdf1e271" (UID: "5b0ce962-5762-4188-b540-beeabdf1e271"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:10:25.037809 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.037778    2571 generic.go:356] "Generic (PLEG): container finished" podID="5b0ce962-5762-4188-b540-beeabdf1e271" containerID="42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c" exitCode=0
Jul 10 21:10:25.037976 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.037822    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"
Jul 10 21:10:25.037976 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.037868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5" event={"ID":"5b0ce962-5762-4188-b540-beeabdf1e271","Type":"ContainerDied","Data":"42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c"}
Jul 10 21:10:25.037976 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.037914    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5" event={"ID":"5b0ce962-5762-4188-b540-beeabdf1e271","Type":"ContainerDied","Data":"3ee249d4917b10617402b77abb24ec5b58bbdfc90c967175be9c4387e8f4ede7"}
Jul 10 21:10:25.037976 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.037935    2571 scope.go:117] "RemoveContainer" containerID="42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c"
Jul 10 21:10:25.048050 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.048030    2571 scope.go:117] "RemoveContainer" containerID="42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c"
Jul 10 21:10:25.048296 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:10:25.048276    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c\": container with ID starting with 42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c not found: ID does not exist" containerID="42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c"
Jul 10 21:10:25.048345 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.048304    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c"} err="failed to get container status \"42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c\": rpc error: code = NotFound desc = could not find container \"42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c\": container with ID starting with 42e061e83c3c1a1f6fa2efa091fea5aa3055041a0bdee205fbfa69439405899c not found: ID does not exist"
Jul 10 21:10:25.060210 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.060183    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"]
Jul 10 21:10:25.064413 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.064393    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7b3231/test-model-7b3231-kserve-864947749-chjb5"]
Jul 10 21:10:25.100647 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.100615    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvc49\" (UniqueName: \"kubernetes.io/projected/5b0ce962-5762-4188-b540-beeabdf1e271-kube-api-access-cvc49\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.100647 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.100643    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.100838 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.100679    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.100838 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.100689    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b0ce962-5762-4188-b540-beeabdf1e271-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.100838 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.100696    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b0ce962-5762-4188-b540-beeabdf1e271-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.569958 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.569892    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb" podUID="a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" containerName="main" containerID="cri-o://5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190" gracePeriod=45
Jul 10 21:10:25.819106 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.819078    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:10:25.908918 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.908829    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tmp-dir\") pod \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") "
Jul 10 21:10:25.908918 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.908873    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tls-certs\") pod \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") "
Jul 10 21:10:25.909154 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.908930    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-dshm\") pod \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") "
Jul 10 21:10:25.909154 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909074    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-model-cache\") pod \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") "
Jul 10 21:10:25.909154 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909127    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-home\") pod \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") "
Jul 10 21:10:25.909154 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909132    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" (UID: "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.909349 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909157    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmljt\" (UniqueName: \"kubernetes.io/projected/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-kube-api-access-xmljt\") pod \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\" (UID: \"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7\") "
Jul 10 21:10:25.909349 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909310    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-home" (OuterVolumeSpecName: "home") pod "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" (UID: "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.909428 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909352    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" (UID: "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.909481 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909463    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.909547 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909484    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.909547 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.909494    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:25.911172 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.911152    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-dshm" (OuterVolumeSpecName: "dshm") pod "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" (UID: "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:10:25.911293 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.911265    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" (UID: "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:10:25.911330 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:25.911304    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-kube-api-access-xmljt" (OuterVolumeSpecName: "kube-api-access-xmljt") pod "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" (UID: "a2adf783-174d-4aa1-8161-4b9fd4b9f8b7"). InnerVolumeSpecName "kube-api-access-xmljt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:10:26.010890 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.010855    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmljt\" (UniqueName: \"kubernetes.io/projected/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-kube-api-access-xmljt\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:26.010890 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.010884    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:26.010890 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.010893    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:10:26.044438 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.044399    2571 generic.go:356] "Generic (PLEG): container finished" podID="a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" containerID="5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190" exitCode=0
Jul 10 21:10:26.044655 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.044441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb" event={"ID":"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7","Type":"ContainerDied","Data":"5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190"}
Jul 10 21:10:26.044655 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.044490    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb" event={"ID":"a2adf783-174d-4aa1-8161-4b9fd4b9f8b7","Type":"ContainerDied","Data":"7bd96aa3e72654b225dab6fe2bc25563961beb66c83493bd747ed3dee5153188"}
Jul 10 21:10:26.044655 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.044513    2571 scope.go:117] "RemoveContainer" containerID="5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190"
Jul 10 21:10:26.044655 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.044451    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"
Jul 10 21:10:26.054322 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.054303    2571 scope.go:117] "RemoveContainer" containerID="5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190"
Jul 10 21:10:26.054594 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:10:26.054573    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190\": container with ID starting with 5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190 not found: ID does not exist" containerID="5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190"
Jul 10 21:10:26.054644 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.054601    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190"} err="failed to get container status \"5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190\": rpc error: code = NotFound desc = could not find container \"5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190\": container with ID starting with 5342c1ca31d51394eaab8ad088f08aa9458267ebacdc2af5da1283154967d190 not found: ID does not exist"
Jul 10 21:10:26.065595 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.065570    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"]
Jul 10 21:10:26.069966 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.069944    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fc7575/test-model-fc7575-kserve-dcd69fccf-f59jb"]
Jul 10 21:10:26.690249 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.690173    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0ce962-5762-4188-b540-beeabdf1e271" path="/var/lib/kubelet/pods/5b0ce962-5762-4188-b540-beeabdf1e271/volumes"
Jul 10 21:10:26.690595 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:26.690578    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" path="/var/lib/kubelet/pods/a2adf783-174d-4aa1-8161-4b9fd4b9f8b7/volumes"
Jul 10 21:10:57.642449 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:10:57.642415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:11:12.323585 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:11:12.323552    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:11:29.917957 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:11:29.917921    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:11:44.922005 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:11:44.921943    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:12:02.320309 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:02.320273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:12:04.429792 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.429763    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"]
Jul 10 21:12:04.430231 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.430076    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0ce962-5762-4188-b540-beeabdf1e271" containerName="main"
Jul 10 21:12:04.430231 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.430087    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0ce962-5762-4188-b540-beeabdf1e271" containerName="main"
Jul 10 21:12:04.430231 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.430103    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" containerName="main"
Jul 10 21:12:04.430231 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.430109    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" containerName="main"
Jul 10 21:12:04.430231 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.430168    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0ce962-5762-4188-b540-beeabdf1e271" containerName="main"
Jul 10 21:12:04.430231 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.430177    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2adf783-174d-4aa1-8161-4b9fd4b9f8b7" containerName="main"
Jul 10 21:12:04.433196 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.433180    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.436700 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.436653    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"auth-test-model-01037d-kserve-self-signed-certs\""
Jul 10 21:12:04.436700 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.436692    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"openshift-service-ca.crt\""
Jul 10 21:12:04.436886 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.436678    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"kube-root-ca.crt\""
Jul 10 21:12:04.436886 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.436679    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"default-dockercfg-f4vm4\""
Jul 10 21:12:04.445170 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.445147    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"]
Jul 10 21:12:04.512404 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.512369    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrv6\" (UniqueName: \"kubernetes.io/projected/127e9227-32fc-4f10-bdd5-f716d9a61033-kube-api-access-qsrv6\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.512404 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.512404    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-dshm\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.512594 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.512425    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-tmp-dir\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.512594 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.512522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-home\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.512594 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.512550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-model-cache\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.512594 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.512587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127e9227-32fc-4f10-bdd5-f716d9a61033-tls-certs\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613012 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.612977    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127e9227-32fc-4f10-bdd5-f716d9a61033-tls-certs\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613189 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613037    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrv6\" (UniqueName: \"kubernetes.io/projected/127e9227-32fc-4f10-bdd5-f716d9a61033-kube-api-access-qsrv6\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613189 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-dshm\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613189 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-tmp-dir\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613189 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-home\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613402 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613251    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-model-cache\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613611 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-tmp-dir\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613611 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613600    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-home\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.613762 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.613643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-model-cache\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.615337 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.615317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-dshm\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.615584 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.615566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127e9227-32fc-4f10-bdd5-f716d9a61033-tls-certs\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.622053 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.622032    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrv6\" (UniqueName: \"kubernetes.io/projected/127e9227-32fc-4f10-bdd5-f716d9a61033-kube-api-access-qsrv6\") pod \"auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") " pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.742444 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.742347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:04.873826 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:04.873803    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"]
Jul 10 21:12:04.875749 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:12:04.875721    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod127e9227_32fc_4f10_bdd5_f716d9a61033.slice/crio-8b8717e04c19750ab4babc148a9ec40000f1e2c7f1198d0b9a5d762f53a07030 WatchSource:0}: Error finding container 8b8717e04c19750ab4babc148a9ec40000f1e2c7f1198d0b9a5d762f53a07030: Status 404 returned error can't find the container with id 8b8717e04c19750ab4babc148a9ec40000f1e2c7f1198d0b9a5d762f53a07030
Jul 10 21:12:05.567029 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:05.566988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r" event={"ID":"127e9227-32fc-4f10-bdd5-f716d9a61033","Type":"ContainerStarted","Data":"6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae"}
Jul 10 21:12:05.567433 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:05.567039    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r" event={"ID":"127e9227-32fc-4f10-bdd5-f716d9a61033","Type":"ContainerStarted","Data":"8b8717e04c19750ab4babc148a9ec40000f1e2c7f1198d0b9a5d762f53a07030"}
Jul 10 21:12:05.585567 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:05.585517    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r" podStartSLOduration=1.585501475 podStartE2EDuration="1.585501475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:12:05.583786848 +0000 UTC m=+2251.424507613" watchObservedRunningTime="2026-07-10 21:12:05.585501475 +0000 UTC m=+2251.426222227"
Jul 10 21:12:14.742981 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:14.742926    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:14.742981 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:14.742990    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:14.755434 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:14.755410    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:15.632993 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:15.632961    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:12:15.727714 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:15.727682    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:12:22.618646 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.618609    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"]
Jul 10 21:12:22.622771 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.622749    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.625348 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.625327    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"default-dockercfg-zp724\""
Jul 10 21:12:22.626476 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.626456    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"kube-root-ca.crt\""
Jul 10 21:12:22.626551 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.626496    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"openshift-service-ca.crt\""
Jul 10 21:12:22.626622 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.626564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"auth-test-model-e63f46-kserve-self-signed-certs\""
Jul 10 21:12:22.630154 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.630133    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"]
Jul 10 21:12:22.659937 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.659909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-home\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.660066 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.659959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tls-certs\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.660066 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.659978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tmp-dir\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.660066 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.659993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-dshm\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.660066 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.660047    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-model-cache\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.660225 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.660096    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqhhr\" (UniqueName: \"kubernetes.io/projected/de950dff-0ca2-4e4c-94e7-a02c9e1012de-kube-api-access-qqhhr\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761478 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tls-certs\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761478 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tmp-dir\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761765 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-dshm\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761765 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761560    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-model-cache\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761765 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqhhr\" (UniqueName: \"kubernetes.io/projected/de950dff-0ca2-4e4c-94e7-a02c9e1012de-kube-api-access-qqhhr\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761765 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-home\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.761981 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.761940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tmp-dir\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.762060 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.762036    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-model-cache\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.762106 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.762078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-home\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.763915 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.763895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-dshm\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.764106 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.764086    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tls-certs\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.769884 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.769861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqhhr\" (UniqueName: \"kubernetes.io/projected/de950dff-0ca2-4e4c-94e7-a02c9e1012de-kube-api-access-qqhhr\") pod \"auth-test-model-e63f46-kserve-7d5545f899-m96z2\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") " pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:22.933861 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:22.933777    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:23.067187 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:23.067158    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"]
Jul 10 21:12:23.069044 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:12:23.069013    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde950dff_0ca2_4e4c_94e7_a02c9e1012de.slice/crio-ec5a2392dd3d254acea856bcd9a8b8214662daf822049eeb2058443564b2d754 WatchSource:0}: Error finding container ec5a2392dd3d254acea856bcd9a8b8214662daf822049eeb2058443564b2d754: Status 404 returned error can't find the container with id ec5a2392dd3d254acea856bcd9a8b8214662daf822049eeb2058443564b2d754
Jul 10 21:12:23.664245 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:23.664196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2" event={"ID":"de950dff-0ca2-4e4c-94e7-a02c9e1012de","Type":"ContainerStarted","Data":"579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c"}
Jul 10 21:12:23.664245 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:23.664249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2" event={"ID":"de950dff-0ca2-4e4c-94e7-a02c9e1012de","Type":"ContainerStarted","Data":"ec5a2392dd3d254acea856bcd9a8b8214662daf822049eeb2058443564b2d754"}
Jul 10 21:12:23.681998 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:23.681935    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2" podStartSLOduration=1.68192042 podStartE2EDuration="1.68192042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:12:23.680268983 +0000 UTC m=+2269.520989737" watchObservedRunningTime="2026-07-10 21:12:23.68192042 +0000 UTC m=+2269.522641171"
Jul 10 21:12:27.578031 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:27.577995    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:12:32.934273 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:32.934232    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:32.934722 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:32.934295    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:32.946842 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:32.946810    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:33.726163 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:33.726133    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:12:51.619205 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:12:51.619167    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:13:09.520715 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:13:09.520670    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:13:23.929696 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:13:23.929646    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:13:43.129749 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:13:43.129654    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:14:00.635995 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:00.635961    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:14:18.044813 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:18.044778    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:14:31.892566 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:31.892529    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"]
Jul 10 21:14:32.627857 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:32.627818    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"]
Jul 10 21:14:34.816737 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:34.816705    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 21:14:34.830527 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:34.830506    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p76js_6ec479f9-a54e-4141-a556-c0476391b7a3/ovn-acl-logging/0.log"
Jul 10 21:14:36.647969 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:36.647933    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:14:46.649797 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.649763    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"]
Jul 10 21:14:46.652977 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.652959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.655962 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.655941    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"sub-test-model-01037d-kserve-self-signed-certs\""
Jul 10 21:14:46.671037 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.671007    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"]
Jul 10 21:14:46.797178 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.797139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwj4l\" (UniqueName: \"kubernetes.io/projected/1ee5d51a-f324-4f28-9568-0897061aad0a-kube-api-access-bwj4l\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.797356 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.797208    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-home\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.797356 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.797235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-dshm\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.797356 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.797258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-tmp-dir\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.797356 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.797274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee5d51a-f324-4f28-9568-0897061aad0a-tls-certs\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.797356 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.797340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-model-cache\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.897978 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.897939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-home\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.897978 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.897983    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-dshm\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898232 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-tmp-dir\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898232 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee5d51a-f324-4f28-9568-0897061aad0a-tls-certs\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898232 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898186    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-model-cache\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898382 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwj4l\" (UniqueName: \"kubernetes.io/projected/1ee5d51a-f324-4f28-9568-0897061aad0a-kube-api-access-bwj4l\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898441 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898395    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-tmp-dir\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898489 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898460    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-home\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.898555 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.898521    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-model-cache\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.900374 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.900319    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-dshm\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.900632 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.900615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee5d51a-f324-4f28-9568-0897061aad0a-tls-certs\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.909873 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.909846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwj4l\" (UniqueName: \"kubernetes.io/projected/1ee5d51a-f324-4f28-9568-0897061aad0a-kube-api-access-bwj4l\") pod \"sub-test-model-01037d-kserve-7fd876dffc-557h8\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") " pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:46.912598 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.912545    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r" podUID="127e9227-32fc-4f10-bdd5-f716d9a61033" containerName="main" containerID="cri-o://6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae" gracePeriod=45
Jul 10 21:14:46.962122 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:46.962084    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:47.112305 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.112257    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"]
Jul 10 21:14:47.114440 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:14:47.114407    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ee5d51a_f324_4f28_9568_0897061aad0a.slice/crio-f921c9e0e30d235b86ee415a424b38fca8f8e3a467bd3b22c635f3618542ad2a WatchSource:0}: Error finding container f921c9e0e30d235b86ee415a424b38fca8f8e3a467bd3b22c635f3618542ad2a: Status 404 returned error can't find the container with id f921c9e0e30d235b86ee415a424b38fca8f8e3a467bd3b22c635f3618542ad2a
Jul 10 21:14:47.156825 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.156803    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:14:47.302043 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302013    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-home\") pod \"127e9227-32fc-4f10-bdd5-f716d9a61033\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") "
Jul 10 21:14:47.302237 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302056    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127e9227-32fc-4f10-bdd5-f716d9a61033-tls-certs\") pod \"127e9227-32fc-4f10-bdd5-f716d9a61033\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") "
Jul 10 21:14:47.302237 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302092    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-dshm\") pod \"127e9227-32fc-4f10-bdd5-f716d9a61033\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") "
Jul 10 21:14:47.302237 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302109    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-tmp-dir\") pod \"127e9227-32fc-4f10-bdd5-f716d9a61033\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") "
Jul 10 21:14:47.302237 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302135    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-model-cache\") pod \"127e9227-32fc-4f10-bdd5-f716d9a61033\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") "
Jul 10 21:14:47.302237 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302188    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsrv6\" (UniqueName: \"kubernetes.io/projected/127e9227-32fc-4f10-bdd5-f716d9a61033-kube-api-access-qsrv6\") pod \"127e9227-32fc-4f10-bdd5-f716d9a61033\" (UID: \"127e9227-32fc-4f10-bdd5-f716d9a61033\") "
Jul 10 21:14:47.302508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302281    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-home" (OuterVolumeSpecName: "home") pod "127e9227-32fc-4f10-bdd5-f716d9a61033" (UID: "127e9227-32fc-4f10-bdd5-f716d9a61033"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:47.302508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "127e9227-32fc-4f10-bdd5-f716d9a61033" (UID: "127e9227-32fc-4f10-bdd5-f716d9a61033"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:47.302508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302388    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-model-cache" (OuterVolumeSpecName: "model-cache") pod "127e9227-32fc-4f10-bdd5-f716d9a61033" (UID: "127e9227-32fc-4f10-bdd5-f716d9a61033"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:47.302508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302474    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:47.302508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302488    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:47.302508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.302499    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:47.304314 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.304289    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-dshm" (OuterVolumeSpecName: "dshm") pod "127e9227-32fc-4f10-bdd5-f716d9a61033" (UID: "127e9227-32fc-4f10-bdd5-f716d9a61033"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:47.304396 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.304320    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/127e9227-32fc-4f10-bdd5-f716d9a61033-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "127e9227-32fc-4f10-bdd5-f716d9a61033" (UID: "127e9227-32fc-4f10-bdd5-f716d9a61033"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:14:47.304396 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.304336    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127e9227-32fc-4f10-bdd5-f716d9a61033-kube-api-access-qsrv6" (OuterVolumeSpecName: "kube-api-access-qsrv6") pod "127e9227-32fc-4f10-bdd5-f716d9a61033" (UID: "127e9227-32fc-4f10-bdd5-f716d9a61033"). InnerVolumeSpecName "kube-api-access-qsrv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:14:47.401315 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.401279    2571 generic.go:356] "Generic (PLEG): container finished" podID="127e9227-32fc-4f10-bdd5-f716d9a61033" containerID="6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae" exitCode=0
Jul 10 21:14:47.401508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.401331    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"
Jul 10 21:14:47.401508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.401360    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r" event={"ID":"127e9227-32fc-4f10-bdd5-f716d9a61033","Type":"ContainerDied","Data":"6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae"}
Jul 10 21:14:47.401508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.401403    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r" event={"ID":"127e9227-32fc-4f10-bdd5-f716d9a61033","Type":"ContainerDied","Data":"8b8717e04c19750ab4babc148a9ec40000f1e2c7f1198d0b9a5d762f53a07030"}
Jul 10 21:14:47.401508 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.401425    2571 scope.go:117] "RemoveContainer" containerID="6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae"
Jul 10 21:14:47.402985 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.402963    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127e9227-32fc-4f10-bdd5-f716d9a61033-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:47.403108 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.402988    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsrv6\" (UniqueName: \"kubernetes.io/projected/127e9227-32fc-4f10-bdd5-f716d9a61033-kube-api-access-qsrv6\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:47.403108 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.403002    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127e9227-32fc-4f10-bdd5-f716d9a61033-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:47.403108 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.403029    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8" event={"ID":"1ee5d51a-f324-4f28-9568-0897061aad0a","Type":"ContainerStarted","Data":"f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6"}
Jul 10 21:14:47.403108 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.403064    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8" event={"ID":"1ee5d51a-f324-4f28-9568-0897061aad0a","Type":"ContainerStarted","Data":"f921c9e0e30d235b86ee415a424b38fca8f8e3a467bd3b22c635f3618542ad2a"}
Jul 10 21:14:47.411014 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.410998    2571 scope.go:117] "RemoveContainer" containerID="6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae"
Jul 10 21:14:47.411293 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:14:47.411275    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae\": container with ID starting with 6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae not found: ID does not exist" containerID="6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae"
Jul 10 21:14:47.411343 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.411302    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae"} err="failed to get container status \"6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae\": rpc error: code = NotFound desc = could not find container \"6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae\": container with ID starting with 6097ed81c05d258e840611a0f57420b805440bf0e391008435844b159f26cfae not found: ID does not exist"
Jul 10 21:14:47.428645 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.428600    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8" podStartSLOduration=1.428587159 podStartE2EDuration="1.428587159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:14:47.426190484 +0000 UTC m=+2413.266911247" watchObservedRunningTime="2026-07-10 21:14:47.428587159 +0000 UTC m=+2413.269307910"
Jul 10 21:14:47.444367 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.444333    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"]
Jul 10 21:14:47.451168 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.451140    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/auth-test-model-01037d-kserve-6d6b8c6f55-zrs5r"]
Jul 10 21:14:47.648061 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.648017    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2" podUID="de950dff-0ca2-4e4c-94e7-a02c9e1012de" containerName="main" containerID="cri-o://579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c" gracePeriod=45
Jul 10 21:14:47.879735 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:47.879707    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:14:48.007708 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.007677    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tls-certs\") pod \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") "
Jul 10 21:14:48.007878 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.007715    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqhhr\" (UniqueName: \"kubernetes.io/projected/de950dff-0ca2-4e4c-94e7-a02c9e1012de-kube-api-access-qqhhr\") pod \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") "
Jul 10 21:14:48.007878 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.007743    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-home\") pod \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") "
Jul 10 21:14:48.007966 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.007879    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-dshm\") pod \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") "
Jul 10 21:14:48.008014 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.007972    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-home" (OuterVolumeSpecName: "home") pod "de950dff-0ca2-4e4c-94e7-a02c9e1012de" (UID: "de950dff-0ca2-4e4c-94e7-a02c9e1012de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:48.008058 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.008047    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tmp-dir\") pod \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") "
Jul 10 21:14:48.008106 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.008066    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-model-cache\") pod \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\" (UID: \"de950dff-0ca2-4e4c-94e7-a02c9e1012de\") "
Jul 10 21:14:48.008338 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.008295    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "de950dff-0ca2-4e4c-94e7-a02c9e1012de" (UID: "de950dff-0ca2-4e4c-94e7-a02c9e1012de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:48.008445 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.008342    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:48.008445 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.008359    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-model-cache" (OuterVolumeSpecName: "model-cache") pod "de950dff-0ca2-4e4c-94e7-a02c9e1012de" (UID: "de950dff-0ca2-4e4c-94e7-a02c9e1012de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:48.010059 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.010034    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-dshm" (OuterVolumeSpecName: "dshm") pod "de950dff-0ca2-4e4c-94e7-a02c9e1012de" (UID: "de950dff-0ca2-4e4c-94e7-a02c9e1012de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:14:48.010149 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.010103    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "de950dff-0ca2-4e4c-94e7-a02c9e1012de" (UID: "de950dff-0ca2-4e4c-94e7-a02c9e1012de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:14:48.010149 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.010144    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de950dff-0ca2-4e4c-94e7-a02c9e1012de-kube-api-access-qqhhr" (OuterVolumeSpecName: "kube-api-access-qqhhr") pod "de950dff-0ca2-4e4c-94e7-a02c9e1012de" (UID: "de950dff-0ca2-4e4c-94e7-a02c9e1012de"). InnerVolumeSpecName "kube-api-access-qqhhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:14:48.109268 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.109233    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:48.109268 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.109260    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqhhr\" (UniqueName: \"kubernetes.io/projected/de950dff-0ca2-4e4c-94e7-a02c9e1012de-kube-api-access-qqhhr\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:48.109268 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.109269    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:48.109518 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.109279    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:48.109518 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.109288    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de950dff-0ca2-4e4c-94e7-a02c9e1012de-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:14:48.410474 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.410435    2571 generic.go:356] "Generic (PLEG): container finished" podID="de950dff-0ca2-4e4c-94e7-a02c9e1012de" containerID="579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c" exitCode=0
Jul 10 21:14:48.410474 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.410477    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"
Jul 10 21:14:48.410738 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.410514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2" event={"ID":"de950dff-0ca2-4e4c-94e7-a02c9e1012de","Type":"ContainerDied","Data":"579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c"}
Jul 10 21:14:48.410738 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.410554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2" event={"ID":"de950dff-0ca2-4e4c-94e7-a02c9e1012de","Type":"ContainerDied","Data":"ec5a2392dd3d254acea856bcd9a8b8214662daf822049eeb2058443564b2d754"}
Jul 10 21:14:48.410738 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.410572    2571 scope.go:117] "RemoveContainer" containerID="579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c"
Jul 10 21:14:48.422162 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.422136    2571 scope.go:117] "RemoveContainer" containerID="579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c"
Jul 10 21:14:48.422399 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:14:48.422378    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c\": container with ID starting with 579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c not found: ID does not exist" containerID="579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c"
Jul 10 21:14:48.422473 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.422406    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c"} err="failed to get container status \"579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c\": rpc error: code = NotFound desc = could not find container \"579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c\": container with ID starting with 579444fbae23f99562c74e4cac2be6f88bac8a0b0b8b631afd9f58955b90c29c not found: ID does not exist"
Jul 10 21:14:48.439797 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.439771    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"]
Jul 10 21:14:48.445409 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.445387    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/auth-test-model-e63f46-kserve-7d5545f899-m96z2"]
Jul 10 21:14:48.689204 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.689108    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127e9227-32fc-4f10-bdd5-f716d9a61033" path="/var/lib/kubelet/pods/127e9227-32fc-4f10-bdd5-f716d9a61033/volumes"
Jul 10 21:14:48.689612 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:48.689589    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de950dff-0ca2-4e4c-94e7-a02c9e1012de" path="/var/lib/kubelet/pods/de950dff-0ca2-4e4c-94e7-a02c9e1012de/volumes"
Jul 10 21:14:52.363158 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:52.363121    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:14:56.963049 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:56.962965    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:56.963049 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:56.963017    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:56.975761 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:56.975723    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:14:57.468062 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:14:57.468031    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:15:08.330520 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.330486    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"]
Jul 10 21:15:08.331099 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.330981    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127e9227-32fc-4f10-bdd5-f716d9a61033" containerName="main"
Jul 10 21:15:08.331099 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.331000    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="127e9227-32fc-4f10-bdd5-f716d9a61033" containerName="main"
Jul 10 21:15:08.331099 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.331036    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de950dff-0ca2-4e4c-94e7-a02c9e1012de" containerName="main"
Jul 10 21:15:08.331099 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.331045    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="de950dff-0ca2-4e4c-94e7-a02c9e1012de" containerName="main"
Jul 10 21:15:08.331330 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.331122    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="de950dff-0ca2-4e4c-94e7-a02c9e1012de" containerName="main"
Jul 10 21:15:08.331330 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.331137    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="127e9227-32fc-4f10-bdd5-f716d9a61033" containerName="main"
Jul 10 21:15:08.335525 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.335505    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.339198 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.339174    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"kube-root-ca.crt\""
Jul 10 21:15:08.339198 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.339183    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"openshift-service-ca.crt\""
Jul 10 21:15:08.339387 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.339218    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"sub-test-model-e63f46-kserve-self-signed-certs\""
Jul 10 21:15:08.352916 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.352892    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"]
Jul 10 21:15:08.357535 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.357517    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"default-dockercfg-zp724\""
Jul 10 21:15:08.373201 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.373174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-home\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.373289 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.373228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-model-cache\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.373342 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.373318    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-dshm\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.373389 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.373343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c23cd0-d516-4c42-b469-486fc515f328-tls-certs\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.373389 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.373376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d4xr\" (UniqueName: \"kubernetes.io/projected/b9c23cd0-d516-4c42-b469-486fc515f328-kube-api-access-2d4xr\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.373461 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.373445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-tmp-dir\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.474852 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.474819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-dshm\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.474852 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.474852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c23cd0-d516-4c42-b469-486fc515f328-tls-certs\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475093 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.474877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d4xr\" (UniqueName: \"kubernetes.io/projected/b9c23cd0-d516-4c42-b469-486fc515f328-kube-api-access-2d4xr\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475093 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.474910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-tmp-dir\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475093 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.474947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-home\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475093 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.474986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-model-cache\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475383 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.475352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-tmp-dir\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475383 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.475368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-model-cache\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.475574 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.475426    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-home\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.477161 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.477139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-dshm\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.477348 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.477333    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c23cd0-d516-4c42-b469-486fc515f328-tls-certs\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.484612 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.484592    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d4xr\" (UniqueName: \"kubernetes.io/projected/b9c23cd0-d516-4c42-b469-486fc515f328-kube-api-access-2d4xr\") pod \"sub-test-model-e63f46-kserve-698fdd5775-72j2b\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") " pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.645105 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.645015    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:08.788554 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:08.788519    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"]
Jul 10 21:15:08.789362 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:15:08.789339    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c23cd0_d516_4c42_b469_486fc515f328.slice/crio-5d82c381a5b0a8d24623fd511c7900eb38b99c1f7e9d7b498baea9abd9ce0453 WatchSource:0}: Error finding container 5d82c381a5b0a8d24623fd511c7900eb38b99c1f7e9d7b498baea9abd9ce0453: Status 404 returned error can't find the container with id 5d82c381a5b0a8d24623fd511c7900eb38b99c1f7e9d7b498baea9abd9ce0453
Jul 10 21:15:09.518990 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:09.518955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b" event={"ID":"b9c23cd0-d516-4c42-b469-486fc515f328","Type":"ContainerStarted","Data":"ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f"}
Jul 10 21:15:09.519382 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:09.518999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b" event={"ID":"b9c23cd0-d516-4c42-b469-486fc515f328","Type":"ContainerStarted","Data":"5d82c381a5b0a8d24623fd511c7900eb38b99c1f7e9d7b498baea9abd9ce0453"}
Jul 10 21:15:12.758140 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:12.758086    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b" podStartSLOduration=4.7580701340000005 podStartE2EDuration="4.758070134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:15:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:15:09.548384762 +0000 UTC m=+2435.389105513" watchObservedRunningTime="2026-07-10 21:15:12.758070134 +0000 UTC m=+2438.598790895"
Jul 10 21:15:12.760187 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:12.760165    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:15:18.646148 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:18.646106    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:18.646698 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:18.646160    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:18.658654 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:18.658632    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:19.585463 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:19.585434    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:15:32.823934 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:32.823898    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:15:52.169459 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:52.169424    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"]
Jul 10 21:15:53.335377 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:53.335340    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:15:53.380295 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:15:53.380262    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"]
Jul 10 21:16:06.235827 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:06.235794    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:16:07.188980 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.188931    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8" podUID="1ee5d51a-f324-4f28-9568-0897061aad0a" containerName="main" containerID="cri-o://f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6" gracePeriod=45
Jul 10 21:16:07.438063 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.438041    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:16:07.490981 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.490909    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-home\") pod \"1ee5d51a-f324-4f28-9568-0897061aad0a\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") "
Jul 10 21:16:07.490981 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.490958    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-model-cache\") pod \"1ee5d51a-f324-4f28-9568-0897061aad0a\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") "
Jul 10 21:16:07.491186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.490988    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwj4l\" (UniqueName: \"kubernetes.io/projected/1ee5d51a-f324-4f28-9568-0897061aad0a-kube-api-access-bwj4l\") pod \"1ee5d51a-f324-4f28-9568-0897061aad0a\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") "
Jul 10 21:16:07.491186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491007    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-dshm\") pod \"1ee5d51a-f324-4f28-9568-0897061aad0a\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") "
Jul 10 21:16:07.491186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-tmp-dir\") pod \"1ee5d51a-f324-4f28-9568-0897061aad0a\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") "
Jul 10 21:16:07.491186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491056    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee5d51a-f324-4f28-9568-0897061aad0a-tls-certs\") pod \"1ee5d51a-f324-4f28-9568-0897061aad0a\" (UID: \"1ee5d51a-f324-4f28-9568-0897061aad0a\") "
Jul 10 21:16:07.491416 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491202    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-home" (OuterVolumeSpecName: "home") pod "1ee5d51a-f324-4f28-9568-0897061aad0a" (UID: "1ee5d51a-f324-4f28-9568-0897061aad0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:07.491416 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491321    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ee5d51a-f324-4f28-9568-0897061aad0a" (UID: "1ee5d51a-f324-4f28-9568-0897061aad0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:07.491416 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491351    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ee5d51a-f324-4f28-9568-0897061aad0a" (UID: "1ee5d51a-f324-4f28-9568-0897061aad0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:07.491416 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.491366    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:07.493258 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.493231    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ee5d51a-f324-4f28-9568-0897061aad0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ee5d51a-f324-4f28-9568-0897061aad0a" (UID: "1ee5d51a-f324-4f28-9568-0897061aad0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:16:07.493354 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.493257    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-dshm" (OuterVolumeSpecName: "dshm") pod "1ee5d51a-f324-4f28-9568-0897061aad0a" (UID: "1ee5d51a-f324-4f28-9568-0897061aad0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:07.493354 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.493275    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee5d51a-f324-4f28-9568-0897061aad0a-kube-api-access-bwj4l" (OuterVolumeSpecName: "kube-api-access-bwj4l") pod "1ee5d51a-f324-4f28-9568-0897061aad0a" (UID: "1ee5d51a-f324-4f28-9568-0897061aad0a"). InnerVolumeSpecName "kube-api-access-bwj4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:16:07.591963 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.591927    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:07.591963 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.591960    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwj4l\" (UniqueName: \"kubernetes.io/projected/1ee5d51a-f324-4f28-9568-0897061aad0a-kube-api-access-bwj4l\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:07.591963 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.591970    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:07.592169 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.591978    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee5d51a-f324-4f28-9568-0897061aad0a-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:07.592169 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.591987    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee5d51a-f324-4f28-9568-0897061aad0a-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:07.819411 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.819382    2571 generic.go:356] "Generic (PLEG): container finished" podID="1ee5d51a-f324-4f28-9568-0897061aad0a" containerID="f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6" exitCode=0
Jul 10 21:16:07.819606 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.819427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8" event={"ID":"1ee5d51a-f324-4f28-9568-0897061aad0a","Type":"ContainerDied","Data":"f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6"}
Jul 10 21:16:07.819606 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.819454    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8" event={"ID":"1ee5d51a-f324-4f28-9568-0897061aad0a","Type":"ContainerDied","Data":"f921c9e0e30d235b86ee415a424b38fca8f8e3a467bd3b22c635f3618542ad2a"}
Jul 10 21:16:07.819606 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.819426    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"
Jul 10 21:16:07.819606 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.819471    2571 scope.go:117] "RemoveContainer" containerID="f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6"
Jul 10 21:16:07.828926 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.828908    2571 scope.go:117] "RemoveContainer" containerID="f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6"
Jul 10 21:16:07.829182 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:16:07.829163    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6\": container with ID starting with f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6 not found: ID does not exist" containerID="f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6"
Jul 10 21:16:07.829260 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.829194    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6"} err="failed to get container status \"f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6\": rpc error: code = NotFound desc = could not find container \"f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6\": container with ID starting with f1cad2a35809dde956fe1a04d13bca08382b538168943407c1e3044ec522eda6 not found: ID does not exist"
Jul 10 21:16:07.848045 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.848014    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"]
Jul 10 21:16:07.855191 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:07.855171    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/sub-test-model-01037d-kserve-7fd876dffc-557h8"]
Jul 10 21:16:08.399911 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.399868    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b" podUID="b9c23cd0-d516-4c42-b469-486fc515f328" containerName="main" containerID="cri-o://ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f" gracePeriod=45
Jul 10 21:16:08.646540 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.646516    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:16:08.688940 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.688862    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee5d51a-f324-4f28-9568-0897061aad0a" path="/var/lib/kubelet/pods/1ee5d51a-f324-4f28-9568-0897061aad0a/volumes"
Jul 10 21:16:08.701838 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.701812    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-tmp-dir\") pod \"b9c23cd0-d516-4c42-b469-486fc515f328\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") "
Jul 10 21:16:08.701968 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.701858    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-dshm\") pod \"b9c23cd0-d516-4c42-b469-486fc515f328\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") "
Jul 10 21:16:08.701968 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.701886    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c23cd0-d516-4c42-b469-486fc515f328-tls-certs\") pod \"b9c23cd0-d516-4c42-b469-486fc515f328\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") "
Jul 10 21:16:08.701968 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.701931    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d4xr\" (UniqueName: \"kubernetes.io/projected/b9c23cd0-d516-4c42-b469-486fc515f328-kube-api-access-2d4xr\") pod \"b9c23cd0-d516-4c42-b469-486fc515f328\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") "
Jul 10 21:16:08.701968 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.701960    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-model-cache\") pod \"b9c23cd0-d516-4c42-b469-486fc515f328\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") "
Jul 10 21:16:08.702182 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.702041    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-home\") pod \"b9c23cd0-d516-4c42-b469-486fc515f328\" (UID: \"b9c23cd0-d516-4c42-b469-486fc515f328\") "
Jul 10 21:16:08.702182 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.702042    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9c23cd0-d516-4c42-b469-486fc515f328" (UID: "b9c23cd0-d516-4c42-b469-486fc515f328"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:08.702288 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.702247    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9c23cd0-d516-4c42-b469-486fc515f328" (UID: "b9c23cd0-d516-4c42-b469-486fc515f328"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:08.702288 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.702269    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:08.702373 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.702316    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-home" (OuterVolumeSpecName: "home") pod "b9c23cd0-d516-4c42-b469-486fc515f328" (UID: "b9c23cd0-d516-4c42-b469-486fc515f328"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:08.704092 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.704069    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-dshm" (OuterVolumeSpecName: "dshm") pod "b9c23cd0-d516-4c42-b469-486fc515f328" (UID: "b9c23cd0-d516-4c42-b469-486fc515f328"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:16:08.704092 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.704083    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c23cd0-d516-4c42-b469-486fc515f328-kube-api-access-2d4xr" (OuterVolumeSpecName: "kube-api-access-2d4xr") pod "b9c23cd0-d516-4c42-b469-486fc515f328" (UID: "b9c23cd0-d516-4c42-b469-486fc515f328"). InnerVolumeSpecName "kube-api-access-2d4xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:16:08.704210 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.704146    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c23cd0-d516-4c42-b469-486fc515f328-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9c23cd0-d516-4c42-b469-486fc515f328" (UID: "b9c23cd0-d516-4c42-b469-486fc515f328"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:16:08.802915 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.802878    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:08.802915 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.802907    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c23cd0-d516-4c42-b469-486fc515f328-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:08.802915 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.802918    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d4xr\" (UniqueName: \"kubernetes.io/projected/b9c23cd0-d516-4c42-b469-486fc515f328-kube-api-access-2d4xr\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:08.802915 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.802928    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:08.803183 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.802938    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c23cd0-d516-4c42-b469-486fc515f328-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:16:08.825862 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.825833    2571 generic.go:356] "Generic (PLEG): container finished" podID="b9c23cd0-d516-4c42-b469-486fc515f328" containerID="ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f" exitCode=0
Jul 10 21:16:08.825998 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.825883    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"
Jul 10 21:16:08.825998 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.825923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b" event={"ID":"b9c23cd0-d516-4c42-b469-486fc515f328","Type":"ContainerDied","Data":"ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f"}
Jul 10 21:16:08.825998 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.825967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b" event={"ID":"b9c23cd0-d516-4c42-b469-486fc515f328","Type":"ContainerDied","Data":"5d82c381a5b0a8d24623fd511c7900eb38b99c1f7e9d7b498baea9abd9ce0453"}
Jul 10 21:16:08.825998 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.825991    2571 scope.go:117] "RemoveContainer" containerID="ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f"
Jul 10 21:16:08.835105 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.835089    2571 scope.go:117] "RemoveContainer" containerID="ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f"
Jul 10 21:16:08.835369 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:16:08.835352    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f\": container with ID starting with ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f not found: ID does not exist" containerID="ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f"
Jul 10 21:16:08.835436 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.835374    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f"} err="failed to get container status \"ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f\": rpc error: code = NotFound desc = could not find container \"ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f\": container with ID starting with ffc7efe4800737f912cc1f7a04be9dffff487b819dc6e0d07c3dba7d716bea1f not found: ID does not exist"
Jul 10 21:16:08.848873 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.848851    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"]
Jul 10 21:16:08.852423 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:08.852400    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/sub-test-model-e63f46-kserve-698fdd5775-72j2b"]
Jul 10 21:16:10.688402 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:10.688366    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c23cd0-d516-4c42-b469-486fc515f328" path="/var/lib/kubelet/pods/b9c23cd0-d516-4c42-b469-486fc515f328/volumes"
Jul 10 21:16:11.235870 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.235819    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"]
Jul 10 21:16:11.236359 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.236341    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c23cd0-d516-4c42-b469-486fc515f328" containerName="main"
Jul 10 21:16:11.236404 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.236363    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c23cd0-d516-4c42-b469-486fc515f328" containerName="main"
Jul 10 21:16:11.236404 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.236388    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee5d51a-f324-4f28-9568-0897061aad0a" containerName="main"
Jul 10 21:16:11.236404 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.236393    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee5d51a-f324-4f28-9568-0897061aad0a" containerName="main"
Jul 10 21:16:11.236503 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.236451    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee5d51a-f324-4f28-9568-0897061aad0a" containerName="main"
Jul 10 21:16:11.236503 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.236460    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c23cd0-d516-4c42-b469-486fc515f328" containerName="main"
Jul 10 21:16:11.240487 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.240469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.244546 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.244341    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"kube-root-ca.crt\""
Jul 10 21:16:11.244546 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.244392    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"default-dockercfg-f4vm4\""
Jul 10 21:16:11.244546 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.244411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"rate-test-model-01037d-kserve-self-signed-certs\""
Jul 10 21:16:11.244546 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.244494    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-01037d\"/\"openshift-service-ca.crt\""
Jul 10 21:16:11.248827 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.248804    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"]
Jul 10 21:16:11.323461 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.323434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p689z\" (UniqueName: \"kubernetes.io/projected/74cb6b79-50fb-4635-810b-5dc4e5e80429-kube-api-access-p689z\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.323622 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.323473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cb6b79-50fb-4635-810b-5dc4e5e80429-tls-certs\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.323622 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.323536    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-home\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.323622 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.323584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-model-cache\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.323622 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.323610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-dshm\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.323817 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.323634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-tmp-dir\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424035 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.423995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p689z\" (UniqueName: \"kubernetes.io/projected/74cb6b79-50fb-4635-810b-5dc4e5e80429-kube-api-access-p689z\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424207 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424047    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cb6b79-50fb-4635-810b-5dc4e5e80429-tls-certs\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424207 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-home\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424207 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424119    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-model-cache\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424345 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-dshm\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424345 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-tmp-dir\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424530 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424507    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-model-cache\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424609 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-home\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.424703 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.424678    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-tmp-dir\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.426468 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.426437    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-dshm\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.426993 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.426970    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cb6b79-50fb-4635-810b-5dc4e5e80429-tls-certs\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.432946 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.432921    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p689z\" (UniqueName: \"kubernetes.io/projected/74cb6b79-50fb-4635-810b-5dc4e5e80429-kube-api-access-p689z\") pod \"rate-test-model-01037d-kserve-768544b459-n8hnq\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") " pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.551748 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.551716    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:11.688081 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.688052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"]
Jul 10 21:16:11.689104 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:16:11.689078    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74cb6b79_50fb_4635_810b_5dc4e5e80429.slice/crio-243fd9b7dddc0653322ad57768afcf551a6c45f5530b1dbc9a9c66e982463ee9 WatchSource:0}: Error finding container 243fd9b7dddc0653322ad57768afcf551a6c45f5530b1dbc9a9c66e982463ee9: Status 404 returned error can't find the container with id 243fd9b7dddc0653322ad57768afcf551a6c45f5530b1dbc9a9c66e982463ee9
Jul 10 21:16:11.849978 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.849896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq" event={"ID":"74cb6b79-50fb-4635-810b-5dc4e5e80429","Type":"ContainerStarted","Data":"67edb274afb49f3d285252f3ef2e9ed071a3dacbd2e176495c48a3fe560e66f5"}
Jul 10 21:16:11.849978 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.849938    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq" event={"ID":"74cb6b79-50fb-4635-810b-5dc4e5e80429","Type":"ContainerStarted","Data":"243fd9b7dddc0653322ad57768afcf551a6c45f5530b1dbc9a9c66e982463ee9"}
Jul 10 21:16:11.869603 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:11.869556    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq" podStartSLOduration=0.869542185 podStartE2EDuration="869.542185ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:16:11.867777564 +0000 UTC m=+2497.708498359" watchObservedRunningTime="2026-07-10 21:16:11.869542185 +0000 UTC m=+2497.710262938"
Jul 10 21:16:14.762975 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:14.762944    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:16:21.552128 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:21.552078    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:21.552128 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:21.552143    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:21.564937 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:21.564913    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:21.912801 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:21.912714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:16:40.229185 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.229152    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"]
Jul 10 21:16:40.233867 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.233844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.237855 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.237835    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"default-dockercfg-zp724\""
Jul 10 21:16:40.237855 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.237846    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"kube-root-ca.crt\""
Jul 10 21:16:40.238050 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.237846    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"openshift-service-ca.crt\""
Jul 10 21:16:40.238050 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.237835    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e63f46\"/\"rate-test-model-e63f46-kserve-self-signed-certs\""
Jul 10 21:16:40.244331 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.244309    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"]
Jul 10 21:16:40.379708 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.379647    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-tmp-dir\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.379880 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.379753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-home\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.379880 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.379772    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96678305-ee22-4477-819c-ece46e56b9ca-tls-certs\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.379880 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.379800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnhb9\" (UniqueName: \"kubernetes.io/projected/96678305-ee22-4477-819c-ece46e56b9ca-kube-api-access-jnhb9\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.379880 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.379821    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-dshm\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.380022 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.379902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-model-cache\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481046 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.480954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-home\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481046 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.480994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96678305-ee22-4477-819c-ece46e56b9ca-tls-certs\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481046 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnhb9\" (UniqueName: \"kubernetes.io/projected/96678305-ee22-4477-819c-ece46e56b9ca-kube-api-access-jnhb9\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481046 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-dshm\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481347 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-model-cache\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481347 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-tmp-dir\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481527 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-home\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481527 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481521    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-tmp-dir\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.481651 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.481605    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-model-cache\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.483816 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.483795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-dshm\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.484076 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.484060    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96678305-ee22-4477-819c-ece46e56b9ca-tls-certs\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.489963 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.489944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnhb9\" (UniqueName: \"kubernetes.io/projected/96678305-ee22-4477-819c-ece46e56b9ca-kube-api-access-jnhb9\") pod \"rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") " pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.543557 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.543515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:40.682022 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:40.681993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"]
Jul 10 21:16:40.683767 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:16:40.683729    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96678305_ee22_4477_819c_ece46e56b9ca.slice/crio-e45374f37b56bac79d9c5fa011132df60ebaca2d0279349bf54b6091946cba17 WatchSource:0}: Error finding container e45374f37b56bac79d9c5fa011132df60ebaca2d0279349bf54b6091946cba17: Status 404 returned error can't find the container with id e45374f37b56bac79d9c5fa011132df60ebaca2d0279349bf54b6091946cba17
Jul 10 21:16:41.001962 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:41.001863    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt" event={"ID":"96678305-ee22-4477-819c-ece46e56b9ca","Type":"ContainerStarted","Data":"1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a"}
Jul 10 21:16:41.001962 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:41.001903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt" event={"ID":"96678305-ee22-4477-819c-ece46e56b9ca","Type":"ContainerStarted","Data":"e45374f37b56bac79d9c5fa011132df60ebaca2d0279349bf54b6091946cba17"}
Jul 10 21:16:41.020357 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:41.020306    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt" podStartSLOduration=1.020290389 podStartE2EDuration="1.020290389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:16:41.018831173 +0000 UTC m=+2526.859551928" watchObservedRunningTime="2026-07-10 21:16:41.020290389 +0000 UTC m=+2526.861011140"
Jul 10 21:16:44.526182 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:44.526144    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:16:50.544270 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:50.544236    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:50.544722 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:50.544497    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:50.557228 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:50.557205    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:16:51.064323 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:16:51.064289    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:17:06.424779 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:06.424739    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:17:21.952417 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:21.952386    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:17:28.118195 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:28.118157    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"]
Jul 10 21:17:28.926263 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:28.926231    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"]
Jul 10 21:17:29.890428 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:29.890394    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7372-140596747236912"]
Jul 10 21:17:29.893788 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:29.893770    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:29.913308 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:29.913282    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-g86md\""
Jul 10 21:17:29.915611 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:29.915584    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596747236912"]
Jul 10 21:17:30.007039 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:30.007008    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqhnj\" (UniqueName: \"kubernetes.io/projected/79d82fcc-23e1-4374-b2de-537d0da7006a-kube-api-access-zqhnj\") pod \"test-curl-7372-140596747236912\" (UID: \"79d82fcc-23e1-4374-b2de-537d0da7006a\") " pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:30.107669 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:30.107625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqhnj\" (UniqueName: \"kubernetes.io/projected/79d82fcc-23e1-4374-b2de-537d0da7006a-kube-api-access-zqhnj\") pod \"test-curl-7372-140596747236912\" (UID: \"79d82fcc-23e1-4374-b2de-537d0da7006a\") " pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:30.116299 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:30.116271    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqhnj\" (UniqueName: \"kubernetes.io/projected/79d82fcc-23e1-4374-b2de-537d0da7006a-kube-api-access-zqhnj\") pod \"test-curl-7372-140596747236912\" (UID: \"79d82fcc-23e1-4374-b2de-537d0da7006a\") " pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:30.204640 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:30.204558    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:30.340040 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:30.340016    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596747236912"]
Jul 10 21:17:30.342026 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:17:30.341997    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79d82fcc_23e1_4374_b2de_537d0da7006a.slice/crio-db558a9496ecd93f3130521471b0ac6d61d1cba6e3d35ce9ad34c984d69d9695 WatchSource:0}: Error finding container db558a9496ecd93f3130521471b0ac6d61d1cba6e3d35ce9ad34c984d69d9695: Status 404 returned error can't find the container with id db558a9496ecd93f3130521471b0ac6d61d1cba6e3d35ce9ad34c984d69d9695
Jul 10 21:17:30.343342 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:30.343324    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 21:17:31.263786 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:31.263754    2571 generic.go:356] "Generic (PLEG): container finished" podID="79d82fcc-23e1-4374-b2de-537d0da7006a" containerID="26581dff0400b54c36269c35096d0e394a46b1b4a3d629be120527b57d67105b" exitCode=0
Jul 10 21:17:31.264182 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:31.263841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596747236912" event={"ID":"79d82fcc-23e1-4374-b2de-537d0da7006a","Type":"ContainerDied","Data":"26581dff0400b54c36269c35096d0e394a46b1b4a3d629be120527b57d67105b"}
Jul 10 21:17:31.264182 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:31.263891    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596747236912" event={"ID":"79d82fcc-23e1-4374-b2de-537d0da7006a","Type":"ContainerStarted","Data":"db558a9496ecd93f3130521471b0ac6d61d1cba6e3d35ce9ad34c984d69d9695"}
Jul 10 21:17:32.405140 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.405113    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:32.442593 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.442557    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7372-140596747236912_79d82fcc-23e1-4374-b2de-537d0da7006a/test-curl-7372-140596747236912/0.log"
Jul 10 21:17:32.467133 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.467104    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7372-140596747236912"]
Jul 10 21:17:32.469034 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.469015    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7372-140596747236912"]
Jul 10 21:17:32.528381 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.528322    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqhnj\" (UniqueName: \"kubernetes.io/projected/79d82fcc-23e1-4374-b2de-537d0da7006a-kube-api-access-zqhnj\") pod \"79d82fcc-23e1-4374-b2de-537d0da7006a\" (UID: \"79d82fcc-23e1-4374-b2de-537d0da7006a\") "
Jul 10 21:17:32.530387 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.530356    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d82fcc-23e1-4374-b2de-537d0da7006a-kube-api-access-zqhnj" (OuterVolumeSpecName: "kube-api-access-zqhnj") pod "79d82fcc-23e1-4374-b2de-537d0da7006a" (UID: "79d82fcc-23e1-4374-b2de-537d0da7006a"). InnerVolumeSpecName "kube-api-access-zqhnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:32.590654 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.590621    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7372-140596747238448"]
Jul 10 21:17:32.591050 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.591032    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d82fcc-23e1-4374-b2de-537d0da7006a" containerName="test-curl-7372-140596747236912"
Jul 10 21:17:32.591124 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.591052    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d82fcc-23e1-4374-b2de-537d0da7006a" containerName="test-curl-7372-140596747236912"
Jul 10 21:17:32.591186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.591142    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="79d82fcc-23e1-4374-b2de-537d0da7006a" containerName="test-curl-7372-140596747236912"
Jul 10 21:17:32.594234 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.594216    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:32.598511 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.598490    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596747238448"]
Jul 10 21:17:32.629671 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.629631    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqhnj\" (UniqueName: \"kubernetes.io/projected/79d82fcc-23e1-4374-b2de-537d0da7006a-kube-api-access-zqhnj\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:32.688685 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.688643    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79d82fcc-23e1-4374-b2de-537d0da7006a" path="/var/lib/kubelet/pods/79d82fcc-23e1-4374-b2de-537d0da7006a/volumes"
Jul 10 21:17:32.731000 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.730970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfc4x\" (UniqueName: \"kubernetes.io/projected/1ac7838f-6289-4386-a95b-40545b934c78-kube-api-access-pfc4x\") pod \"test-curl-7372-140596747238448\" (UID: \"1ac7838f-6289-4386-a95b-40545b934c78\") " pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:32.832058 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.832024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfc4x\" (UniqueName: \"kubernetes.io/projected/1ac7838f-6289-4386-a95b-40545b934c78-kube-api-access-pfc4x\") pod \"test-curl-7372-140596747238448\" (UID: \"1ac7838f-6289-4386-a95b-40545b934c78\") " pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:32.841193 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.841163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfc4x\" (UniqueName: \"kubernetes.io/projected/1ac7838f-6289-4386-a95b-40545b934c78-kube-api-access-pfc4x\") pod \"test-curl-7372-140596747238448\" (UID: \"1ac7838f-6289-4386-a95b-40545b934c78\") " pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:32.904117 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:32.904064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:33.036186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:33.036160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596747238448"]
Jul 10 21:17:33.038157 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:17:33.038127    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ac7838f_6289_4386_a95b_40545b934c78.slice/crio-3c3e99bdea303521883c5f69fe406e1b2ec10e9585156cfce23dd5b128fac053 WatchSource:0}: Error finding container 3c3e99bdea303521883c5f69fe406e1b2ec10e9585156cfce23dd5b128fac053: Status 404 returned error can't find the container with id 3c3e99bdea303521883c5f69fe406e1b2ec10e9585156cfce23dd5b128fac053
Jul 10 21:17:33.275133 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:33.275098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596747238448" event={"ID":"1ac7838f-6289-4386-a95b-40545b934c78","Type":"ContainerStarted","Data":"3c3e99bdea303521883c5f69fe406e1b2ec10e9585156cfce23dd5b128fac053"}
Jul 10 21:17:33.276276 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:33.276256    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747236912"
Jul 10 21:17:33.276276 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:33.276265    2571 scope.go:117] "RemoveContainer" containerID="26581dff0400b54c36269c35096d0e394a46b1b4a3d629be120527b57d67105b"
Jul 10 21:17:34.283093 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:34.283056    2571 generic.go:356] "Generic (PLEG): container finished" podID="1ac7838f-6289-4386-a95b-40545b934c78" containerID="a3598926ba1395ca1d69a8e1de0b618f218369afe9c8a7abb38161e53d5740d7" exitCode=0
Jul 10 21:17:34.283552 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:34.283149    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596747238448" event={"ID":"1ac7838f-6289-4386-a95b-40545b934c78","Type":"ContainerDied","Data":"a3598926ba1395ca1d69a8e1de0b618f218369afe9c8a7abb38161e53d5740d7"}
Jul 10 21:17:35.442488 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.442455    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:35.463954 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.463917    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7372-140596747238448_1ac7838f-6289-4386-a95b-40545b934c78/test-curl-7372-140596747238448/0.log"
Jul 10 21:17:35.490535 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.490507    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7372-140596747238448"]
Jul 10 21:17:35.495016 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.494988    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7372-140596747238448"]
Jul 10 21:17:35.552848 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.552826    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfc4x\" (UniqueName: \"kubernetes.io/projected/1ac7838f-6289-4386-a95b-40545b934c78-kube-api-access-pfc4x\") pod \"1ac7838f-6289-4386-a95b-40545b934c78\" (UID: \"1ac7838f-6289-4386-a95b-40545b934c78\") "
Jul 10 21:17:35.555013 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.554985    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac7838f-6289-4386-a95b-40545b934c78-kube-api-access-pfc4x" (OuterVolumeSpecName: "kube-api-access-pfc4x") pod "1ac7838f-6289-4386-a95b-40545b934c78" (UID: "1ac7838f-6289-4386-a95b-40545b934c78"). InnerVolumeSpecName "kube-api-access-pfc4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:35.653903 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.653863    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:35.654077 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.653975    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfc4x\" (UniqueName: \"kubernetes.io/projected/1ac7838f-6289-4386-a95b-40545b934c78-kube-api-access-pfc4x\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:35.654252 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.654239    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac7838f-6289-4386-a95b-40545b934c78" containerName="test-curl-7372-140596747238448"
Jul 10 21:17:35.654298 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.654254    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac7838f-6289-4386-a95b-40545b934c78" containerName="test-curl-7372-140596747238448"
Jul 10 21:17:35.654333 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.654323    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac7838f-6289-4386-a95b-40545b934c78" containerName="test-curl-7372-140596747238448"
Jul 10 21:17:35.657285 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.657269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:35.664085 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.664031    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:35.755320 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.755291    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q52wh\" (UniqueName: \"kubernetes.io/projected/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b-kube-api-access-q52wh\") pod \"test-curl-7372-140596751828864\" (UID: \"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b\") " pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:35.856722 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.856598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q52wh\" (UniqueName: \"kubernetes.io/projected/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b-kube-api-access-q52wh\") pod \"test-curl-7372-140596751828864\" (UID: \"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b\") " pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:35.866415 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.866389    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q52wh\" (UniqueName: \"kubernetes.io/projected/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b-kube-api-access-q52wh\") pod \"test-curl-7372-140596751828864\" (UID: \"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b\") " pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:35.966788 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:35.966756    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:36.096625 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:36.096593    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:36.097544 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:17:36.097510    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92f3ea0f_ba63_49d1_8fae_f14b451c6b2b.slice/crio-53eba2aa09a489f8b1043f1b6ac44cc1475634eb9143e12a317863d55c8487a3 WatchSource:0}: Error finding container 53eba2aa09a489f8b1043f1b6ac44cc1475634eb9143e12a317863d55c8487a3: Status 404 returned error can't find the container with id 53eba2aa09a489f8b1043f1b6ac44cc1475634eb9143e12a317863d55c8487a3
Jul 10 21:17:36.301489 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:36.301458    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c3e99bdea303521883c5f69fe406e1b2ec10e9585156cfce23dd5b128fac053"
Jul 10 21:17:36.301489 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:36.301460    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:36.302719 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:36.302693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751828864" event={"ID":"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b","Type":"ContainerStarted","Data":"53eba2aa09a489f8b1043f1b6ac44cc1475634eb9143e12a317863d55c8487a3"}
Jul 10 21:17:36.312546 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:17:36.312519    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7372-140596747238448\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="1ac7838f-6289-4386-a95b-40545b934c78" pod="openshift-ingress/test-curl-7372-140596747238448"
Jul 10 21:17:36.689006 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:36.688928    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac7838f-6289-4386-a95b-40545b934c78" path="/var/lib/kubelet/pods/1ac7838f-6289-4386-a95b-40545b934c78/volumes"
Jul 10 21:17:37.309919 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:37.309881    2571 generic.go:356] "Generic (PLEG): container finished" podID="92f3ea0f-ba63-49d1-8fae-f14b451c6b2b" containerID="e3d6367e1f763492eca1d05a5112f99f4e964a1f010e6572224c7bce64652f34" exitCode=0
Jul 10 21:17:37.310073 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:37.309966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751828864" event={"ID":"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b","Type":"ContainerDied","Data":"e3d6367e1f763492eca1d05a5112f99f4e964a1f010e6572224c7bce64652f34"}
Jul 10 21:17:38.448295 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.448266    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:38.468537 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.468506    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7372-140596751828864_92f3ea0f-ba63-49d1-8fae-f14b451c6b2b/test-curl-7372-140596751828864/0.log"
Jul 10 21:17:38.475728 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.475702    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q52wh\" (UniqueName: \"kubernetes.io/projected/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b-kube-api-access-q52wh\") pod \"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b\" (UID: \"92f3ea0f-ba63-49d1-8fae-f14b451c6b2b\") "
Jul 10 21:17:38.477683 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.477646    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b-kube-api-access-q52wh" (OuterVolumeSpecName: "kube-api-access-q52wh") pod "92f3ea0f-ba63-49d1-8fae-f14b451c6b2b" (UID: "92f3ea0f-ba63-49d1-8fae-f14b451c6b2b"). InnerVolumeSpecName "kube-api-access-q52wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:38.490894 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.490871    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:38.493168 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.493147    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:38.576374 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.576282    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q52wh\" (UniqueName: \"kubernetes.io/projected/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b-kube-api-access-q52wh\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:38.611162 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.611128    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:38.611484 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.611470    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f3ea0f-ba63-49d1-8fae-f14b451c6b2b" containerName="test-curl-7372-140596751828864"
Jul 10 21:17:38.611530 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.611486    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f3ea0f-ba63-49d1-8fae-f14b451c6b2b" containerName="test-curl-7372-140596751828864"
Jul 10 21:17:38.611566 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.611550    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f3ea0f-ba63-49d1-8fae-f14b451c6b2b" containerName="test-curl-7372-140596751828864"
Jul 10 21:17:38.614403 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.614387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:38.618983 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.618955    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:38.676583 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.676540    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6hf5\" (UniqueName: \"kubernetes.io/projected/9fb88177-e7df-4409-8f78-06c900ef4987-kube-api-access-t6hf5\") pod \"test-curl-7372-140596751828864\" (UID: \"9fb88177-e7df-4409-8f78-06c900ef4987\") " pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:38.689044 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.689016    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f3ea0f-ba63-49d1-8fae-f14b451c6b2b" path="/var/lib/kubelet/pods/92f3ea0f-ba63-49d1-8fae-f14b451c6b2b/volumes"
Jul 10 21:17:38.777670 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.777624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6hf5\" (UniqueName: \"kubernetes.io/projected/9fb88177-e7df-4409-8f78-06c900ef4987-kube-api-access-t6hf5\") pod \"test-curl-7372-140596751828864\" (UID: \"9fb88177-e7df-4409-8f78-06c900ef4987\") " pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:38.786196 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.786164    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6hf5\" (UniqueName: \"kubernetes.io/projected/9fb88177-e7df-4409-8f78-06c900ef4987-kube-api-access-t6hf5\") pod \"test-curl-7372-140596751828864\" (UID: \"9fb88177-e7df-4409-8f78-06c900ef4987\") " pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:38.925036 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:38.924945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:39.058572 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:39.058548    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:39.060594 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:17:39.060565    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb88177_e7df_4409_8f78_06c900ef4987.slice/crio-49f20cf953d1cc34b6f325dd8d64f6a485a2b1ae0fb7dfeebf00515c2fb18d20 WatchSource:0}: Error finding container 49f20cf953d1cc34b6f325dd8d64f6a485a2b1ae0fb7dfeebf00515c2fb18d20: Status 404 returned error can't find the container with id 49f20cf953d1cc34b6f325dd8d64f6a485a2b1ae0fb7dfeebf00515c2fb18d20
Jul 10 21:17:39.320607 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:39.320573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751828864" event={"ID":"9fb88177-e7df-4409-8f78-06c900ef4987","Type":"ContainerStarted","Data":"49f20cf953d1cc34b6f325dd8d64f6a485a2b1ae0fb7dfeebf00515c2fb18d20"}
Jul 10 21:17:39.321755 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:39.321727    2571 scope.go:117] "RemoveContainer" containerID="e3d6367e1f763492eca1d05a5112f99f4e964a1f010e6572224c7bce64652f34"
Jul 10 21:17:39.321875 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:39.321737    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:40.325567 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:40.325537    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:17:40.330433 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:40.330404    2571 generic.go:356] "Generic (PLEG): container finished" podID="9fb88177-e7df-4409-8f78-06c900ef4987" containerID="dd2b84b189244cf2b18c9a0c0c3bab3d398e564cce115db7f0a109c2cdf8fcae" exitCode=0
Jul 10 21:17:40.330577 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:40.330482    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751828864" event={"ID":"9fb88177-e7df-4409-8f78-06c900ef4987","Type":"ContainerDied","Data":"dd2b84b189244cf2b18c9a0c0c3bab3d398e564cce115db7f0a109c2cdf8fcae"}
Jul 10 21:17:41.477485 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.477462    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:41.498263 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.498233    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6hf5\" (UniqueName: \"kubernetes.io/projected/9fb88177-e7df-4409-8f78-06c900ef4987-kube-api-access-t6hf5\") pod \"9fb88177-e7df-4409-8f78-06c900ef4987\" (UID: \"9fb88177-e7df-4409-8f78-06c900ef4987\") "
Jul 10 21:17:41.498789 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.498765    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7372-140596751828864_9fb88177-e7df-4409-8f78-06c900ef4987/test-curl-7372-140596751828864/0.log"
Jul 10 21:17:41.500173 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.500152    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb88177-e7df-4409-8f78-06c900ef4987-kube-api-access-t6hf5" (OuterVolumeSpecName: "kube-api-access-t6hf5") pod "9fb88177-e7df-4409-8f78-06c900ef4987" (UID: "9fb88177-e7df-4409-8f78-06c900ef4987"). InnerVolumeSpecName "kube-api-access-t6hf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:41.523070 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.523042    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:41.529712 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.529691    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7372-140596751828864"]
Jul 10 21:17:41.598862 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.598798    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6hf5\" (UniqueName: \"kubernetes.io/projected/9fb88177-e7df-4409-8f78-06c900ef4987-kube-api-access-t6hf5\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:41.646838 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.646806    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:41.647200 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.647183    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb88177-e7df-4409-8f78-06c900ef4987" containerName="test-curl-7372-140596751828864"
Jul 10 21:17:41.647290 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.647203    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb88177-e7df-4409-8f78-06c900ef4987" containerName="test-curl-7372-140596751828864"
Jul 10 21:17:41.647347 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.647320    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb88177-e7df-4409-8f78-06c900ef4987" containerName="test-curl-7372-140596751828864"
Jul 10 21:17:41.650282 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.650261    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:41.655490 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.655466    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:41.699770 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.699734    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzfh\" (UniqueName: \"kubernetes.io/projected/5e446d68-35a7-4c70-8a51-2c2f61c2078a-kube-api-access-kgzfh\") pod \"test-curl-7372-140596751829872\" (UID: \"5e446d68-35a7-4c70-8a51-2c2f61c2078a\") " pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:41.801095 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.801060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzfh\" (UniqueName: \"kubernetes.io/projected/5e446d68-35a7-4c70-8a51-2c2f61c2078a-kube-api-access-kgzfh\") pod \"test-curl-7372-140596751829872\" (UID: \"5e446d68-35a7-4c70-8a51-2c2f61c2078a\") " pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:41.810199 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.810167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzfh\" (UniqueName: \"kubernetes.io/projected/5e446d68-35a7-4c70-8a51-2c2f61c2078a-kube-api-access-kgzfh\") pod \"test-curl-7372-140596751829872\" (UID: \"5e446d68-35a7-4c70-8a51-2c2f61c2078a\") " pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:41.960900 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:41.960817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:42.089186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:42.089162    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:42.091315 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:17:42.091289    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e446d68_35a7_4c70_8a51_2c2f61c2078a.slice/crio-c9eccc37d58e74eec380c3886a6b51be6c15ae9322e3e06e0a7d7a74e10de94e WatchSource:0}: Error finding container c9eccc37d58e74eec380c3886a6b51be6c15ae9322e3e06e0a7d7a74e10de94e: Status 404 returned error can't find the container with id c9eccc37d58e74eec380c3886a6b51be6c15ae9322e3e06e0a7d7a74e10de94e
Jul 10 21:17:42.341839 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:42.341806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751829872" event={"ID":"5e446d68-35a7-4c70-8a51-2c2f61c2078a","Type":"ContainerStarted","Data":"c9eccc37d58e74eec380c3886a6b51be6c15ae9322e3e06e0a7d7a74e10de94e"}
Jul 10 21:17:42.343064 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:42.343046    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:42.343176 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:42.343087    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49f20cf953d1cc34b6f325dd8d64f6a485a2b1ae0fb7dfeebf00515c2fb18d20"
Jul 10 21:17:42.353163 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:17:42.353134    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7372-140596751828864\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="9fb88177-e7df-4409-8f78-06c900ef4987" pod="openshift-ingress/test-curl-7372-140596751828864"
Jul 10 21:17:42.694889 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:42.694805    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb88177-e7df-4409-8f78-06c900ef4987" path="/var/lib/kubelet/pods/9fb88177-e7df-4409-8f78-06c900ef4987/volumes"
Jul 10 21:17:43.138815 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.138755    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq" podUID="74cb6b79-50fb-4635-810b-5dc4e5e80429" containerName="main" containerID="cri-o://67edb274afb49f3d285252f3ef2e9ed071a3dacbd2e176495c48a3fe560e66f5" gracePeriod=45
Jul 10 21:17:43.350722 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.350689    2571 generic.go:356] "Generic (PLEG): container finished" podID="74cb6b79-50fb-4635-810b-5dc4e5e80429" containerID="67edb274afb49f3d285252f3ef2e9ed071a3dacbd2e176495c48a3fe560e66f5" exitCode=0
Jul 10 21:17:43.350898 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.350762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq" event={"ID":"74cb6b79-50fb-4635-810b-5dc4e5e80429","Type":"ContainerDied","Data":"67edb274afb49f3d285252f3ef2e9ed071a3dacbd2e176495c48a3fe560e66f5"}
Jul 10 21:17:43.352355 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.352332    2571 generic.go:356] "Generic (PLEG): container finished" podID="5e446d68-35a7-4c70-8a51-2c2f61c2078a" containerID="241f162187db1c48aaab1396040832d2f145526a15c6918a20e866100587aa88" exitCode=0
Jul 10 21:17:43.352464 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.352388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751829872" event={"ID":"5e446d68-35a7-4c70-8a51-2c2f61c2078a","Type":"ContainerDied","Data":"241f162187db1c48aaab1396040832d2f145526a15c6918a20e866100587aa88"}
Jul 10 21:17:43.386981 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.386948    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:17:43.416761 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.416688    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p689z\" (UniqueName: \"kubernetes.io/projected/74cb6b79-50fb-4635-810b-5dc4e5e80429-kube-api-access-p689z\") pod \"74cb6b79-50fb-4635-810b-5dc4e5e80429\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") "
Jul 10 21:17:43.416761 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.416725    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cb6b79-50fb-4635-810b-5dc4e5e80429-tls-certs\") pod \"74cb6b79-50fb-4635-810b-5dc4e5e80429\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") "
Jul 10 21:17:43.416761 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.416751    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-tmp-dir\") pod \"74cb6b79-50fb-4635-810b-5dc4e5e80429\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") "
Jul 10 21:17:43.417026 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.416802    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-dshm\") pod \"74cb6b79-50fb-4635-810b-5dc4e5e80429\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") "
Jul 10 21:17:43.417026 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.416820    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-model-cache\") pod \"74cb6b79-50fb-4635-810b-5dc4e5e80429\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") "
Jul 10 21:17:43.417026 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.416894    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-home\") pod \"74cb6b79-50fb-4635-810b-5dc4e5e80429\" (UID: \"74cb6b79-50fb-4635-810b-5dc4e5e80429\") "
Jul 10 21:17:43.417198 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.417067    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74cb6b79-50fb-4635-810b-5dc4e5e80429" (UID: "74cb6b79-50fb-4635-810b-5dc4e5e80429"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:43.417198 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.417147    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-model-cache" (OuterVolumeSpecName: "model-cache") pod "74cb6b79-50fb-4635-810b-5dc4e5e80429" (UID: "74cb6b79-50fb-4635-810b-5dc4e5e80429"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:43.417293 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.417205    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:43.417293 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.417260    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-home" (OuterVolumeSpecName: "home") pod "74cb6b79-50fb-4635-810b-5dc4e5e80429" (UID: "74cb6b79-50fb-4635-810b-5dc4e5e80429"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:43.418934 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.418900    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74cb6b79-50fb-4635-810b-5dc4e5e80429-kube-api-access-p689z" (OuterVolumeSpecName: "kube-api-access-p689z") pod "74cb6b79-50fb-4635-810b-5dc4e5e80429" (UID: "74cb6b79-50fb-4635-810b-5dc4e5e80429"). InnerVolumeSpecName "kube-api-access-p689z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:43.418934 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.418919    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74cb6b79-50fb-4635-810b-5dc4e5e80429-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74cb6b79-50fb-4635-810b-5dc4e5e80429" (UID: "74cb6b79-50fb-4635-810b-5dc4e5e80429"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:17:43.419229 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.419211    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-dshm" (OuterVolumeSpecName: "dshm") pod "74cb6b79-50fb-4635-810b-5dc4e5e80429" (UID: "74cb6b79-50fb-4635-810b-5dc4e5e80429"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:43.517721 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.517693    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:43.517721 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.517719    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:43.517721 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.517729    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74cb6b79-50fb-4635-810b-5dc4e5e80429-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:43.517939 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.517739    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p689z\" (UniqueName: \"kubernetes.io/projected/74cb6b79-50fb-4635-810b-5dc4e5e80429-kube-api-access-p689z\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:43.517939 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.517750    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74cb6b79-50fb-4635-810b-5dc4e5e80429-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:43.946636 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:43.946589    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt" podUID="96678305-ee22-4477-819c-ece46e56b9ca" containerName="main" containerID="cri-o://1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a" gracePeriod=45
Jul 10 21:17:44.198734 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.198675    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:17:44.222748 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.222722    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnhb9\" (UniqueName: \"kubernetes.io/projected/96678305-ee22-4477-819c-ece46e56b9ca-kube-api-access-jnhb9\") pod \"96678305-ee22-4477-819c-ece46e56b9ca\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") "
Jul 10 21:17:44.222902 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.222763    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-dshm\") pod \"96678305-ee22-4477-819c-ece46e56b9ca\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") "
Jul 10 21:17:44.222902 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.222821    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96678305-ee22-4477-819c-ece46e56b9ca-tls-certs\") pod \"96678305-ee22-4477-819c-ece46e56b9ca\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") "
Jul 10 21:17:44.222902 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.222859    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-model-cache\") pod \"96678305-ee22-4477-819c-ece46e56b9ca\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") "
Jul 10 21:17:44.223071 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.222912    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-home\") pod \"96678305-ee22-4477-819c-ece46e56b9ca\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") "
Jul 10 21:17:44.223071 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.222940    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-tmp-dir\") pod \"96678305-ee22-4477-819c-ece46e56b9ca\" (UID: \"96678305-ee22-4477-819c-ece46e56b9ca\") "
Jul 10 21:17:44.223412 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.223381    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-home" (OuterVolumeSpecName: "home") pod "96678305-ee22-4477-819c-ece46e56b9ca" (UID: "96678305-ee22-4477-819c-ece46e56b9ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:44.223412 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.223401    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "96678305-ee22-4477-819c-ece46e56b9ca" (UID: "96678305-ee22-4477-819c-ece46e56b9ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:44.223696 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.223646    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "96678305-ee22-4477-819c-ece46e56b9ca" (UID: "96678305-ee22-4477-819c-ece46e56b9ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:44.225072 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.225052    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96678305-ee22-4477-819c-ece46e56b9ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "96678305-ee22-4477-819c-ece46e56b9ca" (UID: "96678305-ee22-4477-819c-ece46e56b9ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 21:17:44.225400 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.225309    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-dshm" (OuterVolumeSpecName: "dshm") pod "96678305-ee22-4477-819c-ece46e56b9ca" (UID: "96678305-ee22-4477-819c-ece46e56b9ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 21:17:44.225400 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.225345    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96678305-ee22-4477-819c-ece46e56b9ca-kube-api-access-jnhb9" (OuterVolumeSpecName: "kube-api-access-jnhb9") pod "96678305-ee22-4477-819c-ece46e56b9ca" (UID: "96678305-ee22-4477-819c-ece46e56b9ca"). InnerVolumeSpecName "kube-api-access-jnhb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:44.324379 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.324341    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96678305-ee22-4477-819c-ece46e56b9ca-tls-certs\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.324379 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.324372    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-model-cache\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.324379 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.324383    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-home\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.324620 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.324395    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-tmp-dir\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.324620 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.324407    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnhb9\" (UniqueName: \"kubernetes.io/projected/96678305-ee22-4477-819c-ece46e56b9ca-kube-api-access-jnhb9\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.324620 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.324418    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96678305-ee22-4477-819c-ece46e56b9ca-dshm\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.359050 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.359022    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"
Jul 10 21:17:44.359212 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.359050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq" event={"ID":"74cb6b79-50fb-4635-810b-5dc4e5e80429","Type":"ContainerDied","Data":"243fd9b7dddc0653322ad57768afcf551a6c45f5530b1dbc9a9c66e982463ee9"}
Jul 10 21:17:44.359212 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.359096    2571 scope.go:117] "RemoveContainer" containerID="67edb274afb49f3d285252f3ef2e9ed071a3dacbd2e176495c48a3fe560e66f5"
Jul 10 21:17:44.360454 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.360429    2571 generic.go:356] "Generic (PLEG): container finished" podID="96678305-ee22-4477-819c-ece46e56b9ca" containerID="1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a" exitCode=0
Jul 10 21:17:44.360566 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.360472    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"
Jul 10 21:17:44.360566 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.360503    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt" event={"ID":"96678305-ee22-4477-819c-ece46e56b9ca","Type":"ContainerDied","Data":"1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a"}
Jul 10 21:17:44.360566 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.360541    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt" event={"ID":"96678305-ee22-4477-819c-ece46e56b9ca","Type":"ContainerDied","Data":"e45374f37b56bac79d9c5fa011132df60ebaca2d0279349bf54b6091946cba17"}
Jul 10 21:17:44.371050 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.371024    2571 scope.go:117] "RemoveContainer" containerID="1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a"
Jul 10 21:17:44.380403 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.380377    2571 scope.go:117] "RemoveContainer" containerID="1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a"
Jul 10 21:17:44.380691 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:17:44.380654    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a\": container with ID starting with 1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a not found: ID does not exist" containerID="1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a"
Jul 10 21:17:44.380766 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.380703    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a"} err="failed to get container status \"1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a\": rpc error: code = NotFound desc = could not find container \"1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a\": container with ID starting with 1d1de1cd9fb73503d246f902a951ba79f18a6cec01310a05c860d740ef0fb37a not found: ID does not exist"
Jul 10 21:17:44.388013 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.387989    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"]
Jul 10 21:17:44.393961 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.393930    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-01037d/rate-test-model-01037d-kserve-768544b459-n8hnq"]
Jul 10 21:17:44.402329 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.402305    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"]
Jul 10 21:17:44.406730 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.406706    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e63f46/rate-test-model-e63f46-kserve-5bbd85c94c-f7sjt"]
Jul 10 21:17:44.504465 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.504439    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:44.524605 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.524572    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7372-140596751829872_5e446d68-35a7-4c70-8a51-2c2f61c2078a/test-curl-7372-140596751829872/0.log"
Jul 10 21:17:44.525783 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.525764    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgzfh\" (UniqueName: \"kubernetes.io/projected/5e446d68-35a7-4c70-8a51-2c2f61c2078a-kube-api-access-kgzfh\") pod \"5e446d68-35a7-4c70-8a51-2c2f61c2078a\" (UID: \"5e446d68-35a7-4c70-8a51-2c2f61c2078a\") "
Jul 10 21:17:44.527788 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.527762    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e446d68-35a7-4c70-8a51-2c2f61c2078a-kube-api-access-kgzfh" (OuterVolumeSpecName: "kube-api-access-kgzfh") pod "5e446d68-35a7-4c70-8a51-2c2f61c2078a" (UID: "5e446d68-35a7-4c70-8a51-2c2f61c2078a"). InnerVolumeSpecName "kube-api-access-kgzfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:44.548017 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.547985    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:44.554082 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.554061    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:44.626419 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.626377    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgzfh\" (UniqueName: \"kubernetes.io/projected/5e446d68-35a7-4c70-8a51-2c2f61c2078a-kube-api-access-kgzfh\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:44.678226 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678196    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:44.678529 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678518    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74cb6b79-50fb-4635-810b-5dc4e5e80429" containerName="main"
Jul 10 21:17:44.678572 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678531    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="74cb6b79-50fb-4635-810b-5dc4e5e80429" containerName="main"
Jul 10 21:17:44.678572 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678546    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e446d68-35a7-4c70-8a51-2c2f61c2078a" containerName="test-curl-7372-140596751829872"
Jul 10 21:17:44.678572 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678553    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e446d68-35a7-4c70-8a51-2c2f61c2078a" containerName="test-curl-7372-140596751829872"
Jul 10 21:17:44.678572 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678565    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96678305-ee22-4477-819c-ece46e56b9ca" containerName="main"
Jul 10 21:17:44.678572 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678570    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="96678305-ee22-4477-819c-ece46e56b9ca" containerName="main"
Jul 10 21:17:44.678739 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678649    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="74cb6b79-50fb-4635-810b-5dc4e5e80429" containerName="main"
Jul 10 21:17:44.678739 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678671    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="96678305-ee22-4477-819c-ece46e56b9ca" containerName="main"
Jul 10 21:17:44.678739 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.678680    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e446d68-35a7-4c70-8a51-2c2f61c2078a" containerName="test-curl-7372-140596751829872"
Jul 10 21:17:44.681583 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.681566    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:44.690301 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.690269    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e446d68-35a7-4c70-8a51-2c2f61c2078a" path="/var/lib/kubelet/pods/5e446d68-35a7-4c70-8a51-2c2f61c2078a/volumes"
Jul 10 21:17:44.690794 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.690775    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74cb6b79-50fb-4635-810b-5dc4e5e80429" path="/var/lib/kubelet/pods/74cb6b79-50fb-4635-810b-5dc4e5e80429/volumes"
Jul 10 21:17:44.691268 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.691250    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96678305-ee22-4477-819c-ece46e56b9ca" path="/var/lib/kubelet/pods/96678305-ee22-4477-819c-ece46e56b9ca/volumes"
Jul 10 21:17:44.691548 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.691536    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:44.727002 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.726980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkhkd\" (UniqueName: \"kubernetes.io/projected/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2-kube-api-access-nkhkd\") pod \"test-curl-7372-140596751829872\" (UID: \"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2\") " pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:44.828083 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.828060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkhkd\" (UniqueName: \"kubernetes.io/projected/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2-kube-api-access-nkhkd\") pod \"test-curl-7372-140596751829872\" (UID: \"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2\") " pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:44.837010 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.836981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkhkd\" (UniqueName: \"kubernetes.io/projected/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2-kube-api-access-nkhkd\") pod \"test-curl-7372-140596751829872\" (UID: \"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2\") " pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:44.991482 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:44.991452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:45.121073 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:45.121043    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:45.122779 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:17:45.122755    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2f9dbda_6e48_41ce_acb5_97a8b2df68d2.slice/crio-189a19753768d4b80371b4a706b29a66234882094f03c8f4e37660912b8ed34b WatchSource:0}: Error finding container 189a19753768d4b80371b4a706b29a66234882094f03c8f4e37660912b8ed34b: Status 404 returned error can't find the container with id 189a19753768d4b80371b4a706b29a66234882094f03c8f4e37660912b8ed34b
Jul 10 21:17:45.375204 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:45.375106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751829872" event={"ID":"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2","Type":"ContainerStarted","Data":"189a19753768d4b80371b4a706b29a66234882094f03c8f4e37660912b8ed34b"}
Jul 10 21:17:45.376258 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:45.376233    2571 scope.go:117] "RemoveContainer" containerID="241f162187db1c48aaab1396040832d2f145526a15c6918a20e866100587aa88"
Jul 10 21:17:45.376258 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:45.376258    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:45.380363 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:45.380331    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7372-140596751829872" oldPodUID="5e446d68-35a7-4c70-8a51-2c2f61c2078a" podUID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2"
Jul 10 21:17:46.383626 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:46.383589    2571 generic.go:356] "Generic (PLEG): container finished" podID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" containerID="75372d01eb42441f75997613a0a38c83b21744be3643e92327466af2349fe33c" exitCode=0
Jul 10 21:17:46.384003 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:46.383648    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7372-140596751829872" event={"ID":"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2","Type":"ContainerDied","Data":"75372d01eb42441f75997613a0a38c83b21744be3643e92327466af2349fe33c"}
Jul 10 21:17:47.526865 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.526840    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:47.545457 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.545420    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7372-140596751829872_a2f9dbda-6e48-41ce-acb5-97a8b2df68d2/test-curl-7372-140596751829872/0.log"
Jul 10 21:17:47.549564 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.549545    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkhkd\" (UniqueName: \"kubernetes.io/projected/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2-kube-api-access-nkhkd\") pod \"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2\" (UID: \"a2f9dbda-6e48-41ce-acb5-97a8b2df68d2\") "
Jul 10 21:17:47.551530 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.551505    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2-kube-api-access-nkhkd" (OuterVolumeSpecName: "kube-api-access-nkhkd") pod "a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" (UID: "a2f9dbda-6e48-41ce-acb5-97a8b2df68d2"). InnerVolumeSpecName "kube-api-access-nkhkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 21:17:47.569163 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.569135    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:47.571987 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.571967    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7372-140596751829872"]
Jul 10 21:17:47.650930 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:47.650846    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkhkd\" (UniqueName: \"kubernetes.io/projected/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2-kube-api-access-nkhkd\") on node \"ip-10-0-139-118.ec2.internal\" DevicePath \"\""
Jul 10 21:17:48.395460 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:48.395429    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:48.395615 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:48.395465    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="189a19753768d4b80371b4a706b29a66234882094f03c8f4e37660912b8ed34b"
Jul 10 21:17:48.406328 ip-10-0-139-118 kubenswrapper[2571]: E0710 21:17:48.406302    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7372-140596751829872\" is forbidden: User \"system:node:ip-10-0-139-118.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-118.ec2.internal' and this object" podUID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" pod="openshift-ingress/test-curl-7372-140596751829872"
Jul 10 21:17:48.688565 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:48.688469    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" path="/var/lib/kubelet/pods/a2f9dbda-6e48-41ce-acb5-97a8b2df68d2/volumes"
Jul 10 21:17:51.130123 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:17:51.130088    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:18:04.826611 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:04.826577    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbjzf"]
Jul 10 21:18:07.562445 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:07.562412    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5798c7df-whp96_df76b25d-c484-4903-aa56-1c992aa5aa15/copy-manifests/0.log"
Jul 10 21:18:07.569292 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:07.569265    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5798c7df-whp96_df76b25d-c484-4903-aa56-1c992aa5aa15/manager/0.log"
Jul 10 21:18:08.922133 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:08.922105    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl_11e4f520-0a5e-459b-bf4d-2ff48a28d73c/extract/0.log"
Jul 10 21:18:08.927965 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:08.927944    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl_11e4f520-0a5e-459b-bf4d-2ff48a28d73c/util/0.log"
Jul 10 21:18:08.936428 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:08.936408    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl_11e4f520-0a5e-459b-bf4d-2ff48a28d73c/pull/0.log"
Jul 10 21:18:09.042527 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.042504    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h_8704a693-1329-4d73-a9c1-2c46b9d2361d/util/0.log"
Jul 10 21:18:09.048741 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.048719    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h_8704a693-1329-4d73-a9c1-2c46b9d2361d/pull/0.log"
Jul 10 21:18:09.054987 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.054969    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h_8704a693-1329-4d73-a9c1-2c46b9d2361d/extract/0.log"
Jul 10 21:18:09.168950 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.168926    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp_814f7860-4ba5-4d5c-b3f4-2348e1facb74/util/0.log"
Jul 10 21:18:09.174739 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.174679    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp_814f7860-4ba5-4d5c-b3f4-2348e1facb74/pull/0.log"
Jul 10 21:18:09.180582 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.180564    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp_814f7860-4ba5-4d5c-b3f4-2348e1facb74/extract/0.log"
Jul 10 21:18:09.295885 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.295852    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz_d7e957eb-0aa6-477f-9e18-e6cf0db80416/pull/0.log"
Jul 10 21:18:09.301992 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.301970    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz_d7e957eb-0aa6-477f-9e18-e6cf0db80416/extract/0.log"
Jul 10 21:18:09.307857 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:09.307837    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz_d7e957eb-0aa6-477f-9e18-e6cf0db80416/util/0.log"
Jul 10 21:18:10.103402 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:10.103372    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fbjzf_8e2d4bf4-e03e-4225-ba64-f6905905255f/limitador/0.log"
Jul 10 21:18:10.825302 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:10.825275    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d744644f5-25897_04e76c19-b77e-4a50-b9ee-43d65bc6fc55/kube-auth-proxy/0.log"
Jul 10 21:18:12.099312 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:12.099282    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5qmk_b7e44530-bb00-4b5d-97f7-8f969b55df01/main/0.log"
Jul 10 21:18:12.330673 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:12.330633    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bqb4l_186e73a5-de60-46da-8404-c595d39a6039/main/0.log"
Jul 10 21:18:15.970409 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.970372    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6snqv/must-gather-kfrkw"]
Jul 10 21:18:15.970813 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.970713    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" containerName="test-curl-7372-140596751829872"
Jul 10 21:18:15.970813 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.970725    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" containerName="test-curl-7372-140596751829872"
Jul 10 21:18:15.970813 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.970790    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f9dbda-6e48-41ce-acb5-97a8b2df68d2" containerName="test-curl-7372-140596751829872"
Jul 10 21:18:15.974186 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.974163    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:15.976876 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.976849    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6snqv\"/\"openshift-service-ca.crt\""
Jul 10 21:18:15.976975 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.976872    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6snqv\"/\"default-dockercfg-5mrqk\""
Jul 10 21:18:15.976975 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.976857    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6snqv\"/\"kube-root-ca.crt\""
Jul 10 21:18:15.985448 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:15.985424    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6snqv/must-gather-kfrkw"]
Jul 10 21:18:16.095297 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.095255    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6l47\" (UniqueName: \"kubernetes.io/projected/358bdcf7-2d4e-4b84-a207-b879f42d93aa-kube-api-access-t6l47\") pod \"must-gather-kfrkw\" (UID: \"358bdcf7-2d4e-4b84-a207-b879f42d93aa\") " pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.095490 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.095308    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/358bdcf7-2d4e-4b84-a207-b879f42d93aa-must-gather-output\") pod \"must-gather-kfrkw\" (UID: \"358bdcf7-2d4e-4b84-a207-b879f42d93aa\") " pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.196019 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.195971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6l47\" (UniqueName: \"kubernetes.io/projected/358bdcf7-2d4e-4b84-a207-b879f42d93aa-kube-api-access-t6l47\") pod \"must-gather-kfrkw\" (UID: \"358bdcf7-2d4e-4b84-a207-b879f42d93aa\") " pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.196019 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.196024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/358bdcf7-2d4e-4b84-a207-b879f42d93aa-must-gather-output\") pod \"must-gather-kfrkw\" (UID: \"358bdcf7-2d4e-4b84-a207-b879f42d93aa\") " pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.196420 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.196402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/358bdcf7-2d4e-4b84-a207-b879f42d93aa-must-gather-output\") pod \"must-gather-kfrkw\" (UID: \"358bdcf7-2d4e-4b84-a207-b879f42d93aa\") " pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.204205 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.204177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6l47\" (UniqueName: \"kubernetes.io/projected/358bdcf7-2d4e-4b84-a207-b879f42d93aa-kube-api-access-t6l47\") pod \"must-gather-kfrkw\" (UID: \"358bdcf7-2d4e-4b84-a207-b879f42d93aa\") " pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.284348 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.284272    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6snqv/must-gather-kfrkw"
Jul 10 21:18:16.421060 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.421035    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6snqv/must-gather-kfrkw"]
Jul 10 21:18:16.423064 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:18:16.423037    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod358bdcf7_2d4e_4b84_a207_b879f42d93aa.slice/crio-2311b52fc308e06d5112316e81de66879c1d6bef7c24eaeec926c6f7020b574d WatchSource:0}: Error finding container 2311b52fc308e06d5112316e81de66879c1d6bef7c24eaeec926c6f7020b574d: Status 404 returned error can't find the container with id 2311b52fc308e06d5112316e81de66879c1d6bef7c24eaeec926c6f7020b574d
Jul 10 21:18:16.554846 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:16.554809    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6snqv/must-gather-kfrkw" event={"ID":"358bdcf7-2d4e-4b84-a207-b879f42d93aa","Type":"ContainerStarted","Data":"2311b52fc308e06d5112316e81de66879c1d6bef7c24eaeec926c6f7020b574d"}
Jul 10 21:18:17.563129 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:17.563083    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6snqv/must-gather-kfrkw" event={"ID":"358bdcf7-2d4e-4b84-a207-b879f42d93aa","Type":"ContainerStarted","Data":"e8e3e95fe2c79c465ba709e99c350c432bac6b0640069c6ab85ea4243f3a0008"}
Jul 10 21:18:17.563766 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:17.563147    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6snqv/must-gather-kfrkw" event={"ID":"358bdcf7-2d4e-4b84-a207-b879f42d93aa","Type":"ContainerStarted","Data":"f7203d2055ae76ef7a5893971cf65d1e9bfe1370bd62687ac5535558b0d53ac5"}
Jul 10 21:18:17.579591 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:17.579110    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6snqv/must-gather-kfrkw" podStartSLOduration=1.7366226249999999 podStartE2EDuration="2.579077241s" totalImagesPullingTime="842.454616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:18:17.579032424 +0000 UTC m=+2623.419753178" watchObservedRunningTime="2026-07-10 21:18:17.579077241 +0000 UTC m=+2623.419797991"
Jul 10 21:18:18.911581 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:18.911547    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p55qj_c380fc70-5a8a-4390-9e39-1b2113fd658b/global-pull-secret-syncer/0.log"
Jul 10 21:18:19.039524 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:19.039490    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xhzc2_5b550a91-8e4b-4702-a2b5-bddd4615eea9/konnectivity-agent/0.log"
Jul 10 21:18:19.085622 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:19.085589    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-118.ec2.internal_df8c9063ff2754bc27e9321d0dd6e39b/haproxy/0.log"
Jul 10 21:18:23.486221 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.486189    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl_11e4f520-0a5e-459b-bf4d-2ff48a28d73c/extract/0.log"
Jul 10 21:18:23.534358 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.534294    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl_11e4f520-0a5e-459b-bf4d-2ff48a28d73c/util/0.log"
Jul 10 21:18:23.566027 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.565983    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759flfbl_11e4f520-0a5e-459b-bf4d-2ff48a28d73c/pull/0.log"
Jul 10 21:18:23.616503 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.616469    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h_8704a693-1329-4d73-a9c1-2c46b9d2361d/extract/0.log"
Jul 10 21:18:23.646253 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.646223    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h_8704a693-1329-4d73-a9c1-2c46b9d2361d/util/0.log"
Jul 10 21:18:23.674692 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.674629    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0m2g4h_8704a693-1329-4d73-a9c1-2c46b9d2361d/pull/0.log"
Jul 10 21:18:23.703359 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.703327    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp_814f7860-4ba5-4d5c-b3f4-2348e1facb74/extract/0.log"
Jul 10 21:18:23.729030 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.729002    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp_814f7860-4ba5-4d5c-b3f4-2348e1facb74/util/0.log"
Jul 10 21:18:23.752386 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.752302    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737fqnp_814f7860-4ba5-4d5c-b3f4-2348e1facb74/pull/0.log"
Jul 10 21:18:23.781515 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.781480    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz_d7e957eb-0aa6-477f-9e18-e6cf0db80416/extract/0.log"
Jul 10 21:18:23.809279 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.809247    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz_d7e957eb-0aa6-477f-9e18-e6cf0db80416/util/0.log"
Jul 10 21:18:23.833671 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:23.833616    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh7tz_d7e957eb-0aa6-477f-9e18-e6cf0db80416/pull/0.log"
Jul 10 21:18:24.476586 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:24.476556    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fbjzf_8e2d4bf4-e03e-4225-ba64-f6905905255f/limitador/0.log"
Jul 10 21:18:26.911473 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:26.911437    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlvsk_08658ea6-4a7f-4685-bfaf-1c29bae430b9/node-exporter/0.log"
Jul 10 21:18:26.941068 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:26.941039    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlvsk_08658ea6-4a7f-4685-bfaf-1c29bae430b9/kube-rbac-proxy/0.log"
Jul 10 21:18:26.962075 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:26.962039    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mlvsk_08658ea6-4a7f-4685-bfaf-1c29bae430b9/init-textfile/0.log"
Jul 10 21:18:27.257720 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:27.257609    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-tb8s8_981b1651-4183-4c44-b0b9-29b8b526b07f/prometheus-operator/0.log"
Jul 10 21:18:27.280216 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:27.280182    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-tb8s8_981b1651-4183-4c44-b0b9-29b8b526b07f/kube-rbac-proxy/0.log"
Jul 10 21:18:28.673034 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.672962    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-2gbph_44e8013e-6cbf-41cd-b864-b6d3178cf783/networking-console-plugin/0.log"
Jul 10 21:18:28.817139 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.817101    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"]
Jul 10 21:18:28.823086 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.823058    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:28.836044 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.834371    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"]
Jul 10 21:18:28.920705 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.920647    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-lib-modules\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:28.920901 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.920773    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87svj\" (UniqueName: \"kubernetes.io/projected/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-kube-api-access-87svj\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:28.920901 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.920816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-podres\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:28.921034 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.921002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-proc\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:28.921099 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:28.921083    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-sys\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022261 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-proc\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022261 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-sys\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022515 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-lib-modules\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022515 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-sys\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022515 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022352    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87svj\" (UniqueName: \"kubernetes.io/projected/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-kube-api-access-87svj\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022515 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-podres\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022773 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-podres\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022773 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022691    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-lib-modules\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.022773 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.022750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-proc\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.039039 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.039005    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87svj\" (UniqueName: \"kubernetes.io/projected/c3171a85-f9c6-4efa-9448-2ecaacdb69bc-kube-api-access-87svj\") pod \"perf-node-gather-daemonset-9x2zf\" (UID: \"c3171a85-f9c6-4efa-9448-2ecaacdb69bc\") " pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.141264 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.141226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.327639 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.326821    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"]
Jul 10 21:18:29.330044 ip-10-0-139-118 kubenswrapper[2571]: W0710 21:18:29.330017    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3171a85_f9c6_4efa_9448_2ecaacdb69bc.slice/crio-9a2c3ae015c220bc1204a3886c76bfd185635845163923681df04e310258fb25 WatchSource:0}: Error finding container 9a2c3ae015c220bc1204a3886c76bfd185635845163923681df04e310258fb25: Status 404 returned error can't find the container with id 9a2c3ae015c220bc1204a3886c76bfd185635845163923681df04e310258fb25
Jul 10 21:18:29.666453 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.666354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf" event={"ID":"c3171a85-f9c6-4efa-9448-2ecaacdb69bc","Type":"ContainerStarted","Data":"39127c6739700310395d05c96c95038970332adc8440a28b0bcce0b91963ab55"}
Jul 10 21:18:29.666453 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.666430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf" event={"ID":"c3171a85-f9c6-4efa-9448-2ecaacdb69bc","Type":"ContainerStarted","Data":"9a2c3ae015c220bc1204a3886c76bfd185635845163923681df04e310258fb25"}
Jul 10 21:18:29.666806 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.666483    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:29.807359 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.807328    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-54bc4d8d45-rdxx7_a25e55eb-e503-407e-b254-6fdfd9e84527/console/0.log"
Jul 10 21:18:29.841379 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:29.841343    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-44txl_18092ccd-0fd5-4a5f-9627-7cb3ac3a6cdc/download-server/0.log"
Jul 10 21:18:30.397587 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:30.397551    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-xsvk2_92aa9b82-f235-42a1-894e-748920a3d3c6/volume-data-source-validator/0.log"
Jul 10 21:18:31.465293 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:31.465261    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-czgdv_cfb5d8ce-408f-4921-87fc-40ce61423eab/dns/0.log"
Jul 10 21:18:31.486526 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:31.486499    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-czgdv_cfb5d8ce-408f-4921-87fc-40ce61423eab/kube-rbac-proxy/0.log"
Jul 10 21:18:31.617586 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:31.617551    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nzd67_0bff3f7e-55ab-4915-8ea8-6148ac876e50/dns-node-resolver/0.log"
Jul 10 21:18:32.160439 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:32.160398    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq8zn_98aac43a-543e-4b20-8795-82794a28b7a9/node-ca/0.log"
Jul 10 21:18:33.372708 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:33.372679    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d744644f5-25897_04e76c19-b77e-4a50-b9ee-43d65bc6fc55/kube-auth-proxy/0.log"
Jul 10 21:18:34.282533 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:34.282496    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkclj_4d826856-07ef-41ab-b45a-585fc71fa901/serve-healthcheck-canary/0.log"
Jul 10 21:18:34.817560 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:34.817524    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rm2bj_e0c7af49-a396-45b5-8d31-e73add77a445/insights-operator/0.log"
Jul 10 21:18:34.818831 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:34.818805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rm2bj_e0c7af49-a396-45b5-8d31-e73add77a445/insights-operator/1.log"
Jul 10 21:18:35.001782 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:35.001752    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqzlb_649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70/kube-rbac-proxy/0.log"
Jul 10 21:18:35.023452 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:35.023426    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqzlb_649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70/exporter/0.log"
Jul 10 21:18:35.044641 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:35.044613    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqzlb_649b1ada-abd0-49f6-ad3d-b8cfa1ddfb70/extractor/0.log"
Jul 10 21:18:35.685787 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:35.685757    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf"
Jul 10 21:18:35.705806 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:35.705744    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6snqv/perf-node-gather-daemonset-9x2zf" podStartSLOduration=7.705723023 podStartE2EDuration="7.705723023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:18:29.686325442 +0000 UTC m=+2635.527046195" watchObservedRunningTime="2026-07-10 21:18:35.705723023 +0000 UTC m=+2641.546443778"
Jul 10 21:18:37.643353 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:37.643315    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5798c7df-whp96_df76b25d-c484-4903-aa56-1c992aa5aa15/manager/0.log"
Jul 10 21:18:37.666623 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:37.666547    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5798c7df-whp96_df76b25d-c484-4903-aa56-1c992aa5aa15/copy-manifests/0.log"
Jul 10 21:18:39.120799 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:39.120767    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c5b7cd584-9l4j8_9c7adcc2-0b3b-4895-8c44-eb3922d90578/manager/0.log"
Jul 10 21:18:39.658360 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:39.658322    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d744644f5-25897_04e76c19-b77e-4a50-b9ee-43d65bc6fc55/kube-auth-proxy/0.log"
Jul 10 21:18:41.271400 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:41.271322    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d744644f5-25897_04e76c19-b77e-4a50-b9ee-43d65bc6fc55/kube-auth-proxy/0.log"
Jul 10 21:18:44.099308 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:44.099282    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-l6ls5_2d8f99fd-c63c-4ba5-9ea4-b44ca3605253/migrator/0.log"
Jul 10 21:18:44.121133 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:44.121105    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-l6ls5_2d8f99fd-c63c-4ba5-9ea4-b44ca3605253/graceful-termination/0.log"
Jul 10 21:18:44.522877 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:44.522787    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tm69t_03659ba7-1a78-412a-92b0-157e06a38ceb/kube-storage-version-migrator-operator/1.log"
Jul 10 21:18:44.523763 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:44.523729    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tm69t_03659ba7-1a78-412a-92b0-157e06a38ceb/kube-storage-version-migrator-operator/0.log"
Jul 10 21:18:45.663156 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.663126    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/kube-multus-additional-cni-plugins/0.log"
Jul 10 21:18:45.686557 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.686534    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/egress-router-binary-copy/0.log"
Jul 10 21:18:45.713954 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.713927    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/cni-plugins/0.log"
Jul 10 21:18:45.740604 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.740580    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/bond-cni-plugin/0.log"
Jul 10 21:18:45.762461 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.762436    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/routeoverride-cni/0.log"
Jul 10 21:18:45.783561 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.783540    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/whereabouts-cni-bincopy/0.log"
Jul 10 21:18:45.804397 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:45.804369    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9pgtq_7082368f-d1a2-4abb-8afe-5e2a09d5664a/whereabouts-cni/0.log"
Jul 10 21:18:46.052583 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:46.052554    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rfnwc_56b32a88-b39f-4ca1-ad34-c757b5d33edd/kube-multus/0.log"
Jul 10 21:18:46.160703 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:46.160676    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l478j_3b5e65ae-4b6d-448f-b752-4a0535d4e586/network-metrics-daemon/0.log"
Jul 10 21:18:46.180638 ip-10-0-139-118 kubenswrapper[2571]: I0710 21:18:46.180613    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l478j_3b5e65ae-4b6d-448f-b752-4a0535d4e586/kube-rbac-proxy/0.log"