Jul 08 21:04:01.756218 ip-10-0-132-192 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 21:04:01.756230 ip-10-0-132-192 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 21:04:01.756237 ip-10-0-132-192 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 21:04:01.756560 ip-10-0-132-192 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 21:04:12.450074 ip-10-0-132-192 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 08 21:04:12.450089 ip-10-0-132-192 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 17682aa77140491b9c0bfa2ab3ce7e15 --
Jul 08 21:06:01.653647 ip-10-0-132-192 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.970129    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976597    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976617    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976622    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976627    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976631    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976634    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976637    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:01.999838 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976643    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976649    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976654    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976660    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976663    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976667    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976670    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976673    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976676    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976679    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976682    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976685    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976688    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976690    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976694    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976697    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976700    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976703    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976706    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:02.001896 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976709    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976711    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976714    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976716    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976719    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976721    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976724    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976732    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976735    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976737    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976740    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976743    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976746    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976748    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976751    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976754    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976756    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976759    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976762    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976765    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:02.002823 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976767    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976770    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976773    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976776    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976778    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976781    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976784    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976787    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976790    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976792    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976795    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976798    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976800    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976803    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976806    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976808    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976811    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976813    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976816    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976818    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:02.003404 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976821    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976825    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976829    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976832    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976835    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976838    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976840    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976843    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976845    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976848    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976851    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976853    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976856    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976859    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976861    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976864    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976867    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976871    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976874    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976876    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:02.004198 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976879    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976883    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976887    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976891    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976894    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976897    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976899    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976902    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976904    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976907    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976910    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976912    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.976915    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977690    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977697    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977700    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977703    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977707    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977710    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977713    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:02.004941 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977716    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977719    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977721    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977724    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977728    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977731    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977734    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977737    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977739    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977742    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977745    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977747    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977750    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977753    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977756    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977759    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977762    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977764    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977767    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:02.005586 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977771    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977775    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977778    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977781    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977784    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977786    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977789    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977791    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977795    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977798    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977801    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977805    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977808    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977811    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977814    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977816    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977819    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977822    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977825    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977828    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:02.006156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977830    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977833    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977835    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977843    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977846    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977848    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977851    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977853    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977856    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977859    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977861    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977864    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977867    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977870    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977872    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977875    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977877    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977880    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977882    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977885    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:02.006806 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977888    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977890    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977893    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977895    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977898    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977901    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977903    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977906    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977909    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977912    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977915    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977917    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977920    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977923    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977925    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977929    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977932    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977935    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977937    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977940    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:02.007432 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977943    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977946    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977948    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977951    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977953    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977955    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977958    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977960    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977963    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977965    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977968    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977970    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.977973    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978339    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978346    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978349    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978352    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978355    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978357    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978360    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:02.008079 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978381    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978384    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978386    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978389    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978391    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978394    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978397    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978400    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978403    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978407    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978410    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978419    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978423    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978426    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978429    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978432    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978435    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978437    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978440    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978443    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:02.125912 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978445    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:02.039794 ip-10-0-132-192 systemd[1]: Started Kubernetes Kubelet.
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978448    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978451    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978453    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978456    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978458    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978462    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978466    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978470    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978473    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978475    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978478    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978480    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978483    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978486    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978490    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978494    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978497    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978499    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:02.126713 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978504    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978507    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978510    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978513    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978516    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978518    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978521    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978523    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978525    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978528    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978532    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978534    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978537    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978540    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978543    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978545    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978548    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978551    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978553    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978557    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:02.127443 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978559    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978562    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978565    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978568    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978570    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978573    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978575    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978578    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978581    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978583    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978586    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978589    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978593    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978595    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978598    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978600    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978604    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978606    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978608    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978611    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:02.128112 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978614    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978616    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978619    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978621    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978623    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978626    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978628    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978631    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978633    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978636    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978638    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978642    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.978644    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978712    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978719    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978725    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978729    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978734    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978737    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978741    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978746    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 21:06:02.128718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978749    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978752    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978755    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978759    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978762    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978765    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978768    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978771    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978779    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978783    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978788    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978790    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978793    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978796    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978800    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978803    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978806    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978809    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978812    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978815    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978818    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978821    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978825    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978828    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 21:06:02.129352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978832    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978835    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978838    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978841    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978844    2560 flags.go:64] FLAG: --enable-server="true"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978846    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978851    2560 flags.go:64] FLAG: --event-burst="100"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978854    2560 flags.go:64] FLAG: --event-qps="50"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978856    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978859    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978862    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978867    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978870    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978873    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978876    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978878    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978881    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978887    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978891    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978893    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978896    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978899    2560 flags.go:64] FLAG: --feature-gates=""
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978903    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978906    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978909    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 21:06:02.130026 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978912    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978915    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978918    2560 flags.go:64] FLAG: --help="false"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978920    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978924    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978929    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978932    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978935    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978938    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978941    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978943    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978946    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978949    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978952    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978955    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978957    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978960    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978963    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978967    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978970    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978973    2560 flags.go:64] FLAG: --lock-file=""
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978975    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978978    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978981    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 21:06:02.130846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978987    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978993    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978995    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.978998    2560 flags.go:64] FLAG: --logging-format="text"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979001    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979004    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979007    2560 flags.go:64] FLAG: --manifest-url=""
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979009    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979014    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979017    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979021    2560 flags.go:64] FLAG: --max-pods="110"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979023    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979026    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979031    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979034    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979036    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979039    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979042    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979050    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979053    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979056    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979059    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979062    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 21:06:02.131555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979068    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979070    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979073    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979078    2560 flags.go:64] FLAG: --port="10250"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979081    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979084    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-071666330c1365a89"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979087    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979090    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979093    2560 flags.go:64] FLAG: --register-node="true"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979096    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979099    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979102    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979105    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979108    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979112    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979114    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979118    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979120    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979123    2560 flags.go:64] FLAG: --runonce="false"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979126    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979129    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979132    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979135    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979139    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979142    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979145    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 21:06:02.132229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979148    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979150    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979153    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979156    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979158    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979162    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979164    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979167    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979172    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979176    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979179    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979183    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979186    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979189    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979191    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979194    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979197    2560 flags.go:64] FLAG: --v="2"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979201    2560 flags.go:64] FLAG: --version="false"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979205    2560 flags.go:64] FLAG: --vmodule=""
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979209    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979212    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979337    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979341    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979344    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:02.133412 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979347    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979350    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979353    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979355    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979359    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979380    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979383    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979386    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979388    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979391    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979394    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979397    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979399    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979402    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979406    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979410    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979413    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979417    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979420    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:02.134163 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979423    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979425    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979428    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979432    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979435    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979438    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979441    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979444    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979447    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979450    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979452    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979455    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979457    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979460    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979462    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979465    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979467    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979470    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979474    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979476    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:02.288626 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979479    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979481    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979484    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979486    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979489    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979491    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979494    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979496    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979499    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979502    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979505    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979508    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979511    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979513    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979515    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979518    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979520    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979523    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979526    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979528    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:02.289726 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979531    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979534    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979536    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979539    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979541    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979544    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979546    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979549    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979552    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979554    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979558    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979561    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979563    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979566    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979568    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979571    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979573    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979576    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979578    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979581    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:02.290382 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979584    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979586    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979591    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979593    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979595    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979598    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979600    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979603    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979606    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979608    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979611    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979613    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979616    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979619    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979622    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979624    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:02.291194 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.979627    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.979632    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.986562    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.986584    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.987168    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.987182    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987256    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987264    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987270    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987276    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987280    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987286    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987291    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987296    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:02.291831 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987300    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987304    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987308    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987312    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987316    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987319    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987323    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987328    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987336    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987340    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987343    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987347    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987351    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987355    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987358    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987379    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987383    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987387    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987391    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987395    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:02.292657 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987399    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987404    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987408    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987412    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987416    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987419    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987423    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987427    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987431    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987435    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987438    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987442    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987445    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987449    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987453    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987456    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987460    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987464    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987468    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987472    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:02.293280 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987477    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987481    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987485    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987489    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987492    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987496    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987501    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987504    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987508    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987512    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987516    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987519    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987523    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987531    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987536    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987540    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987543    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987548    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987552    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:02.293905 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987555    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987560    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987564    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987568    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987571    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987575    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987579    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987583    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987587    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987590    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987594    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987598    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987602    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987607    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987611    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987615    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987618    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987622    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987626    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987630    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:02.294446 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987634    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987638    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987641    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987645    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987649    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987653    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987658    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987662    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987667    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987670    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987674    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987678    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.987684    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987873    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 21:06:02.295023 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987880    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987884    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987890    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987895    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987900    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987903    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987907    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987911    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987915    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987919    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987922    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987928    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987932    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987936    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987939    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987943    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987946    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987950    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987954    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987958    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 21:06:02.295431 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987962    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987966    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987969    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987973    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987977    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987982    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987987    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987991    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.987995    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988000    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988005    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988008    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988012    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988016    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988019    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988023    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988027    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988030    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988034    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988038    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 21:06:02.296019 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988042    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988046    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988049    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988054    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988058    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988062    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988066    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988070    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988074    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988078    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988082    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988086    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988090    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988094    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988098    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988102    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988106    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988111    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988115    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 21:06:02.296576 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988119    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988124    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988130    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988135    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988139    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988143    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988147    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988151    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988154    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988158    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988161    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988165    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988169    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988173    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988176    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988180    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988186    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988190    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988194    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 21:06:02.297120 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988198    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988202    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988206    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988210    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988214    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988217    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988221    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988225    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988230    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988235    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988239    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988245    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988248    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988252    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988256    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988260    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988264    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988268    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988272    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 21:06:02.297650 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:01.988275    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.988282    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.988458    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.990656    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.991880    2560 server.go:1019] "Starting client certificate rotation"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.991984    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.992543    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.994404    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:01.997230    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.009657    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.011605    2560 log.go:25] "Validated CRI v1 image API"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.012434    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 21:06:02.298189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.016812    2560 fs.go:135] Filesystem UUIDs: map[1800b85d-f519-4461-821e-127a62fa3d75:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9f0de1e1-54cf-40d4-a47f-ef9e51485231:/dev/nvme0n1p4]
Jul 08 21:06:02.298595 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.016827    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.021986    2560 manager.go:216] Machine: {Timestamp:2026-07-08 21:06:02.020856657 +0000 UTC m=+0.272778851 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099408 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23d972dcf82a90165e3e526c3830d3 SystemUUID:ec23d972-dcf8-2a90-165e-3e526c3830d3 BootID:17682aa7-7140-491b-9c0b-fa2ab3ce7e15 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:64:37:90:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:64:37:90:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:b0:96:18:bb:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.022096    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.022179    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.024660    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.024689    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.025782    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.025793    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 21:06:02.298703 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.025801    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.026301    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.027321    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029731    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029850    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029880    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029895    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029910    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029919    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.029930    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.030314    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.030334    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.030618    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.032149    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.033860    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.033893    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034900    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034945    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034953    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034959    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034968    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034973    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034980    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034985    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034992    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.034997    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.035005    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.035010    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.035525    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.035532    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.038740    2560 server.go:1268] "Started kubelet"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.038806    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.038927    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.038986    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.042765    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.043798    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.043809    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.043871    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.044788    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 21:06:02.298977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.045456    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.046027    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-192.ec2.internal.18c06c82ee5388d6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-192.ec2.internal,UID:ip-10-0-132-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-192.ec2.internal,},FirstTimestamp:2026-07-08 21:06:02.03871663 +0000 UTC m=+0.290638822,LastTimestamp:2026-07-08 21:06:02.03871663 +0000 UTC m=+0.290638822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-192.ec2.internal,}"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.047613    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.047759    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.048768    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049274    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049290    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049330    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049434    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049441    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049549    2560 factory.go:55] Registering systemd factory
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049561    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049755    2560 factory.go:153] Registering CRI-O factory
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049768    2560 factory.go:223] Registration of the crio container factory successfully
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049819    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049837    2560 factory.go:103] Registering Raw factory
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.049848    2560 manager.go:1196] Started watching for new ooms in manager
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.050289    2560 manager.go:349] Starting recovery of all containers
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.054031    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.054135    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.057278    2560 manager.go:354] Recovery completed
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.061499    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.063934    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.063977    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.063990    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.064557    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.064567    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.064568    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.064634    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.065267    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.065293    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.065302    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.065664    2560 policy_none.go:49] "None policy: Start"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.065679    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 21:06:02.300106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.065693    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.066041    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-192.ec2.internal.18c06c82efd4b817  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-192.ec2.internal,UID:ip-10-0-132-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-192.ec2.internal,},FirstTimestamp:2026-07-08 21:06:02.063960087 +0000 UTC m=+0.315882284,LastTimestamp:2026-07-08 21:06:02.063960087 +0000 UTC m=+0.315882284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-192.ec2.internal,}"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.066595    2560 policy_none.go:47] "Start"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.073909    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-192.ec2.internal.18c06c82efd5112d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-192.ec2.internal,UID:ip-10-0-132-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-192.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-192.ec2.internal,},FirstTimestamp:2026-07-08 21:06:02.063982893 +0000 UTC m=+0.315905086,LastTimestamp:2026-07-08 21:06:02.063982893 +0000 UTC m=+0.315905086,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-192.ec2.internal,}"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.077216    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-192.ec2.internal.18c06c82efd54273  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-192.ec2.internal,UID:ip-10-0-132-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-192.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-192.ec2.internal,},FirstTimestamp:2026-07-08 21:06:02.063995507 +0000 UTC m=+0.315917702,LastTimestamp:2026-07-08 21:06:02.063995507 +0000 UTC m=+0.315917702,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-192.ec2.internal,}"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.078031    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86559"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.085530    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-86559"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.086779    2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-192.ec2.internal.18c06c82efd4b817\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-192.ec2.internal.18c06c82efd4b817  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-192.ec2.internal,UID:ip-10-0-132-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-192.ec2.internal,},FirstTimestamp:2026-07-08 21:06:02.063960087 +0000 UTC m=+0.315882284,LastTimestamp:2026-07-08 21:06:02.065277971 +0000 UTC m=+0.317200167,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-192.ec2.internal,}"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.111980    2560 manager.go:337] "Starting Device Plugin manager"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.112012    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.112022    2560 server.go:87] "Starting device plugin registration server"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.112281    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 21:06:02.301325 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.112294    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.112425    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.112505    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.112517    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.113025    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.113070    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.197622    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.198903    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.198952    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.198979    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.199016    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.201511    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.213005    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.213808    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.213840    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.213855    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.213885    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.224891    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.224909    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-192.ec2.internal\": node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.242966    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.299882    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"]
Jul 08 21:06:02.301852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.299959    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.302059    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.302083    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.302092    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.303477    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.303607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.303652    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.305272    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.305290    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.305299    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.305645    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.305663    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.305677    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.306192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.306212    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.306976    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.306997    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.307007    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.342037    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-192.ec2.internal\" not found" node="ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.343924    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.346301    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-192.ec2.internal\" not found" node="ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.351586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b623bc6e3b3aed560be61f090f5a652-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal\" (UID: \"1b623bc6e3b3aed560be61f090f5a652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.351606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b623bc6e3b3aed560be61f090f5a652-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal\" (UID: \"1b623bc6e3b3aed560be61f090f5a652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.404175 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.351623    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07d1f4d49abf1d7933a9ae700ae56fff-config\") pod \"kube-apiserver-proxy-ip-10-0-132-192.ec2.internal\" (UID: \"07d1f4d49abf1d7933a9ae700ae56fff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.445043    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.451749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b623bc6e3b3aed560be61f090f5a652-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal\" (UID: \"1b623bc6e3b3aed560be61f090f5a652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.451805    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1b623bc6e3b3aed560be61f090f5a652-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal\" (UID: \"1b623bc6e3b3aed560be61f090f5a652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.451841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b623bc6e3b3aed560be61f090f5a652-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal\" (UID: \"1b623bc6e3b3aed560be61f090f5a652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.451869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07d1f4d49abf1d7933a9ae700ae56fff-config\") pod \"kube-apiserver-proxy-ip-10-0-132-192.ec2.internal\" (UID: \"07d1f4d49abf1d7933a9ae700ae56fff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.451905    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07d1f4d49abf1d7933a9ae700ae56fff-config\") pod \"kube-apiserver-proxy-ip-10-0-132-192.ec2.internal\" (UID: \"07d1f4d49abf1d7933a9ae700ae56fff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.528549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.451931    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b623bc6e3b3aed560be61f090f5a652-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal\" (UID: \"1b623bc6e3b3aed560be61f090f5a652\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.659428 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.545667    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.659428 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.651351    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.659428 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.651397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:02.659428 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.651364    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.800912 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.751530    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.983854 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.852536    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:02.983854 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:02.954869    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.992569    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:02.992726    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:03.054926    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.080745    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.088134    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 21:01:02 +0000 UTC" deadline="2027-12-30 22:25:44.368211535 +0000 UTC"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.088171    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12961h19m41.280043607s"
Jul 08 21:06:03.156961 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:03.155099    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-192.ec2.internal\" not found"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.241405    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.243026    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.243056    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.243071    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeHasSufficientPID"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.245231    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.249109    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.258770    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.260135    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"
Jul 08 21:06:03.317179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.271489    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 21:06:03.592654 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.476605    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:03.592654 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:03.514901    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d1f4d49abf1d7933a9ae700ae56fff.slice/crio-0bf03ede980b65fe5d5e95c3f24bfa0164d67a56c70a173047b3fce135470ee8 WatchSource:0}: Error finding container 0bf03ede980b65fe5d5e95c3f24bfa0164d67a56c70a173047b3fce135470ee8: Status 404 returned error can't find the container with id 0bf03ede980b65fe5d5e95c3f24bfa0164d67a56c70a173047b3fce135470ee8
Jul 08 21:06:03.592654 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:03.515619    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b623bc6e3b3aed560be61f090f5a652.slice/crio-d6f550769ca6d284d790c75d7f05e8e33ab1d0023bf16a7cfab7b6135c4a729a WatchSource:0}: Error finding container d6f550769ca6d284d790c75d7f05e8e33ab1d0023bf16a7cfab7b6135c4a729a: Status 404 returned error can't find the container with id d6f550769ca6d284d790c75d7f05e8e33ab1d0023bf16a7cfab7b6135c4a729a
Jul 08 21:06:03.592654 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:03.522355    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.032196    2560 apiserver.go:52] "Watching apiserver"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.039908    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.042486    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dq52g","openshift-multus/network-metrics-daemon-rnk9k","openshift-ovn-kubernetes/ovnkube-node-mxnx4","kube-system/konnectivity-agent-fskxt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt","openshift-dns/node-resolver-6f5p2","openshift-image-registry/node-ca-sd2bb","openshift-multus/multus-2tx7p","openshift-network-diagnostics/network-check-target-rf9mk","openshift-network-operator/iptables-alerter-nvj8s","kube-system/global-pull-secret-syncer-b62pz","kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2zxff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal"]
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.046654    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.048959    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.049200    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.049466    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.049494    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.049600    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.049668    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dchgh\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.051204    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.051208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8447c\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.051326    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.051364    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.051494    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.051588    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.053493    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.053785    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.053865    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.054691    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.054706    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.054690    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.054774    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-27rm9\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.054879    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.056186    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.056281    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.056296    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.056701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t46bn\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.058318    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9fthh\""
Jul 08 21:06:04.202052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.059089    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.059389    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.060093    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061599    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061756    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-984pn\""
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-etc-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.061833    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061848    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovn-node-metrics-cert\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovnkube-script-lib\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-var-lib-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-cnibin\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.061983    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-os-release\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-conf-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjj8s\" (UniqueName: \"kubernetes.io/projected/c60e3aca-7b31-4ed5-a167-a7c6401248a6-kube-api-access-rjj8s\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-node-log\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062105    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a236567e-f033-45c4-b129-0c0018534103-serviceca\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-netns\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-cni-multus\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-hostroot\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-ovn\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062260    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-kubelet\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062290    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a236567e-f033-45c4-b129-0c0018534103-host\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-slash\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062345    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-systemd\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062361    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovnkube-config\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-env-overrides\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062456    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60e3aca-7b31-4ed5-a167-a7c6401248a6-cni-binary-copy\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.204961 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062474    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsts9\" (UniqueName: \"kubernetes.io/projected/a236567e-f033-45c4-b129-0c0018534103-kube-api-access-nsts9\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062490    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-system-cni-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-kubelet\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-systemd-units\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-run-netns\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-multus-certs\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-cni-netd\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062606    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4nt\" (UniqueName: \"kubernetes.io/projected/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-kube-api-access-fz4nt\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-cni-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-socket-dir-parent\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062654    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-daemon-config\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-etc-kubernetes\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-log-socket\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062749    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-cni-bin\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-k8s-cni-cncf-io\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.062809    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-cni-bin\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.064098    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.064307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.066883    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.066979    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.067533    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jns75\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.067721    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.068098    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.071165    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.073468    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.073561    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dbk4q\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.073729    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.073785    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.073795    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.073796    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.076151    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.078412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.078678    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vghwf\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.078759    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.078829    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.082401    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xgflg"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.088468    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xgflg"
Jul 08 21:06:04.206743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.150445    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.163884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-multus-certs\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.163922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df3b458c-f93d-4ba0-a91c-fa1c90eb631c-agent-certs\") pod \"konnectivity-agent-fskxt\" (UID: \"df3b458c-f93d-4ba0-a91c-fa1c90eb631c\") " pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.163942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsts9\" (UniqueName: \"kubernetes.io/projected/a236567e-f033-45c4-b129-0c0018534103-kube-api-access-nsts9\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.163973    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-system-cni-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.163991    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-systemd-units\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-run-netns\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164014    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-multus-certs\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164074    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-systemd-units\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-kubelet-config\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164136    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-system-cni-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164151    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-run-netns\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.207630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164153    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-daemon-config\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-etc-kubernetes\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164256    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-etc-kubernetes\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df3b458c-f93d-4ba0-a91c-fa1c90eb631c-konnectivity-ca\") pod \"konnectivity-agent-fskxt\" (UID: \"df3b458c-f93d-4ba0-a91c-fa1c90eb631c\") " pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164394    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-kubernetes\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6615206-7688-4b36-a589-82299a33b18c-tmp-dir\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164444    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdt46\" (UniqueName: \"kubernetes.io/projected/a19b781d-37ae-40b6-b470-992503443eba-kube-api-access-cdt46\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164465    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-iptables-alerter-script\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-log-socket\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164636    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-cni-bin\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164647    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-log-socket\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164661    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysctl-conf\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164701    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-cni-bin\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164718    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164723    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8r5\" (UniqueName: \"kubernetes.io/projected/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-kube-api-access-vr8r5\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164773    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-system-cni-dir\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164846    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-dbus\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164862    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-daemon-config\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-etc-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-os-release\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-os-release\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjj8s\" (UniqueName: \"kubernetes.io/projected/c60e3aca-7b31-4ed5-a167-a7c6401248a6-kube-api-access-rjj8s\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.164986    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-etc-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysctl-d\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165030    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5kj\" (UniqueName: \"kubernetes.io/projected/04e8424e-8875-45eb-80a6-37feb009428a-kube-api-access-7j5kj\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165037    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-os-release\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.208884 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165062    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-sys-fs\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-node-log\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a236567e-f033-45c4-b129-0c0018534103-serviceca\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-cni-multus\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-hostroot\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165158    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-modprobe-d\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165182    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-registration-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165174    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-node-log\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165197    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-cni-multus\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165243    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-hostroot\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165250    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-kubelet\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e8424e-8875-45eb-80a6-37feb009428a-tmp\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165533    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a236567e-f033-45c4-b129-0c0018534103-serviceca\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w826m\" (UniqueName: \"kubernetes.io/projected/f6615206-7688-4b36-a589-82299a33b18c-kube-api-access-w826m\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.209672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165858    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-kubelet\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovnkube-config\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysconfig\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.165916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04e8424e-8875-45eb-80a6-37feb009428a-etc-tuned\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166008    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-host-slash\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwgcw\" (UniqueName: \"kubernetes.io/projected/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-kube-api-access-pwgcw\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-kubelet\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-run\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166139    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-cnibin\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-cni-binary-copy\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166166    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-kubelet\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166196    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-cni-netd\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.210202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166248    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4nt\" (UniqueName: \"kubernetes.io/projected/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-kube-api-access-fz4nt\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-cni-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166276    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-cni-netd\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166325    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovnkube-config\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166382    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-socket-dir-parent\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-sys\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-var-lib-kubelet\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166441    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-socket-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166475    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-k8s-cni-cncf-io\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-cni-bin\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166520    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-socket-dir-parent\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166529    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-k8s-cni-cncf-io\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166537    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-cni-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-systemd\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166575    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-var-lib-cni-bin\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355047 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovn-node-metrics-cert\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166633    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovnkube-script-lib\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-host\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166686    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-var-lib-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166710    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-cnibin\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-conf-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166771    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-var-lib-openvswitch\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166778    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-device-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166766    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-cnibin\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-netns\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166806    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-multus-conf-dir\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166832    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60e3aca-7b31-4ed5-a167-a7c6401248a6-host-run-netns\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.355692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-ovn\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.166965    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-lib-modules\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167045    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-ovn\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzrl\" (UniqueName: \"kubernetes.io/projected/a35f8a41-02b3-483f-966f-059027f264be-kube-api-access-4pzrl\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6615206-7688-4b36-a589-82299a33b18c-hosts-file\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167087    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovnkube-script-lib\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167119    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a236567e-f033-45c4-b129-0c0018534103-host\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167151    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-slash\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167174    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-systemd\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167196    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a236567e-f033-45c4-b129-0c0018534103-host\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167230    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-slash\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167249    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.465717 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167275    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-run-systemd\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-env-overrides\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60e3aca-7b31-4ed5-a167-a7c6401248a6-cni-binary-copy\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167388    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167751    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-env-overrides\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.167811    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60e3aca-7b31-4ed5-a167-a7c6401248a6-cni-binary-copy\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.170515    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-ovn-node-metrics-cert\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.172988    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjj8s\" (UniqueName: \"kubernetes.io/projected/c60e3aca-7b31-4ed5-a167-a7c6401248a6-kube-api-access-rjj8s\") pod \"multus-2tx7p\" (UID: \"c60e3aca-7b31-4ed5-a167-a7c6401248a6\") " pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.173387    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsts9\" (UniqueName: \"kubernetes.io/projected/a236567e-f033-45c4-b129-0c0018534103-kube-api-access-nsts9\") pod \"node-ca-sd2bb\" (UID: \"a236567e-f033-45c4-b129-0c0018534103\") " pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.183598    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4nt\" (UniqueName: \"kubernetes.io/projected/16489f09-9fd1-4e1b-a06e-c52f0ee3adfe-kube-api-access-fz4nt\") pod \"ovnkube-node-mxnx4\" (UID: \"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.205154    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal" event={"ID":"1b623bc6e3b3aed560be61f090f5a652","Type":"ContainerStarted","Data":"d6f550769ca6d284d790c75d7f05e8e33ab1d0023bf16a7cfab7b6135c4a729a"}
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.206311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal" event={"ID":"07d1f4d49abf1d7933a9ae700ae56fff","Type":"ContainerStarted","Data":"0bf03ede980b65fe5d5e95c3f24bfa0164d67a56c70a173047b3fce135470ee8"}
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.257690    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdt46\" (UniqueName: \"kubernetes.io/projected/a19b781d-37ae-40b6-b470-992503443eba-kube-api-access-cdt46\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268473    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-iptables-alerter-script\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.469339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysctl-conf\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8r5\" (UniqueName: \"kubernetes.io/projected/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-kube-api-access-vr8r5\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268550    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-system-cni-dir\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-dbus\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268597    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-os-release\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268621    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysctl-d\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5kj\" (UniqueName: \"kubernetes.io/projected/04e8424e-8875-45eb-80a6-37feb009428a-kube-api-access-7j5kj\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268672    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268691    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysctl-conf\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-sys-fs\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268733    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-system-cni-dir\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268745    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-os-release\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-modprobe-d\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268794    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-dbus\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.471074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268816    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-etc-selinux\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268821    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-sys-fs\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268841    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-modprobe-d\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268850    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysctl-d\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268846    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-registration-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268898    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-registration-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e8424e-8875-45eb-80a6-37feb009428a-tmp\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w826m\" (UniqueName: \"kubernetes.io/projected/f6615206-7688-4b36-a589-82299a33b18c-kube-api-access-w826m\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.268996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysconfig\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04e8424e-8875-45eb-80a6-37feb009428a-etc-tuned\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.269019    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-host-slash\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwgcw\" (UniqueName: \"kubernetes.io/projected/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-kube-api-access-pwgcw\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269086    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-host-slash\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.472731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269052    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-sysconfig\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-run\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-cnibin\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-cni-binary-copy\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269209    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-sys\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-var-lib-kubelet\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-socket-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269342    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-systemd\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-host\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269381    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-run\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269420    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-device-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269448    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-cnibin\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.473711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269459    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-iptables-alerter-script\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.269477    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:06:04.769436125 +0000 UTC m=+3.021358313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269481    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-device-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269501    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269516    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-var-lib-kubelet\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269535    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-host\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.269554    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-lib-modules\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.269616    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:06:04.769599595 +0000 UTC m=+3.021521794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269622    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-socket-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzrl\" (UniqueName: \"kubernetes.io/projected/a35f8a41-02b3-483f-966f-059027f264be-kube-api-access-4pzrl\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269673    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.476524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6615206-7688-4b36-a589-82299a33b18c-hosts-file\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269688    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-lib-modules\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269717    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-sys\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269758    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df3b458c-f93d-4ba0-a91c-fa1c90eb631c-agent-certs\") pod \"konnectivity-agent-fskxt\" (UID: \"df3b458c-f93d-4ba0-a91c-fa1c90eb631c\") " pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269770    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-systemd\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269798    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269809    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-cni-binary-copy\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269856    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a35f8a41-02b3-483f-966f-059027f264be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-kubelet-config\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269941    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6615206-7688-4b36-a589-82299a33b18c-hosts-file\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.269990    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-kubelet-config\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df3b458c-f93d-4ba0-a91c-fa1c90eb631c-konnectivity-ca\") pod \"konnectivity-agent-fskxt\" (UID: \"df3b458c-f93d-4ba0-a91c-fa1c90eb631c\") " pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270196    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.477728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270204    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-kubernetes\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270244    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6615206-7688-4b36-a589-82299a33b18c-tmp-dir\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270312    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04e8424e-8875-45eb-80a6-37feb009428a-etc-kubernetes\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270569    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a35f8a41-02b3-483f-966f-059027f264be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.270633    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6615206-7688-4b36-a589-82299a33b18c-tmp-dir\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.271170    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df3b458c-f93d-4ba0-a91c-fa1c90eb631c-konnectivity-ca\") pod \"konnectivity-agent-fskxt\" (UID: \"df3b458c-f93d-4ba0-a91c-fa1c90eb631c\") " pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.271431    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04e8424e-8875-45eb-80a6-37feb009428a-etc-tuned\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.271603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04e8424e-8875-45eb-80a6-37feb009428a-tmp\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.272257    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df3b458c-f93d-4ba0-a91c-fa1c90eb631c-agent-certs\") pod \"konnectivity-agent-fskxt\" (UID: \"df3b458c-f93d-4ba0-a91c-fa1c90eb631c\") " pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.280398    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.280422    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.280436    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.280504    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:04.780485819 +0000 UTC m=+3.032408019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.281545    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdt46\" (UniqueName: \"kubernetes.io/projected/a19b781d-37ae-40b6-b470-992503443eba-kube-api-access-cdt46\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.478688 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.281610    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w826m\" (UniqueName: \"kubernetes.io/projected/f6615206-7688-4b36-a589-82299a33b18c-kube-api-access-w826m\") pod \"node-resolver-6f5p2\" (UID: \"f6615206-7688-4b36-a589-82299a33b18c\") " pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.281798    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8r5\" (UniqueName: \"kubernetes.io/projected/2dc19ccd-9495-48a0-87ac-9b29a0c6c369-kube-api-access-vr8r5\") pod \"aws-ebs-csi-driver-node-kcwjt\" (UID: \"2dc19ccd-9495-48a0-87ac-9b29a0c6c369\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.282063    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5kj\" (UniqueName: \"kubernetes.io/projected/04e8424e-8875-45eb-80a6-37feb009428a-kube-api-access-7j5kj\") pod \"tuned-2zxff\" (UID: \"04e8424e-8875-45eb-80a6-37feb009428a\") " pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.282494    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwgcw\" (UniqueName: \"kubernetes.io/projected/9b0eb8ec-f201-4925-a4f4-eb6e0f28022a-kube-api-access-pwgcw\") pod \"iptables-alerter-nvj8s\" (UID: \"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a\") " pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.282560    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzrl\" (UniqueName: \"kubernetes.io/projected/a35f8a41-02b3-483f-966f-059027f264be-kube-api-access-4pzrl\") pod \"multus-additional-cni-plugins-dq52g\" (UID: \"a35f8a41-02b3-483f-966f-059027f264be\") " pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.356616    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sd2bb"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.367736    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda236567e_f033_45c4_b129_0c0018534103.slice/crio-9f74419ee85b19e8d92b6cc7c604c80f46db07e3f37df4b1cd704b1cc7e907be WatchSource:0}: Error finding container 9f74419ee85b19e8d92b6cc7c604c80f46db07e3f37df4b1cd704b1cc7e907be: Status 404 returned error can't find the container with id 9f74419ee85b19e8d92b6cc7c604c80f46db07e3f37df4b1cd704b1cc7e907be
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.371660    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tx7p"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.378552    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.380635    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60e3aca_7b31_4ed5_a167_a7c6401248a6.slice/crio-1fbd92e546e69d5cdd12c791beda02bb4ba988c2db8de2ea2abd21e3a93f8f85 WatchSource:0}: Error finding container 1fbd92e546e69d5cdd12c791beda02bb4ba988c2db8de2ea2abd21e3a93f8f85: Status 404 returned error can't find the container with id 1fbd92e546e69d5cdd12c791beda02bb4ba988c2db8de2ea2abd21e3a93f8f85
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.382276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.388012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dq52g"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.390637    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16489f09_9fd1_4e1b_a06e_c52f0ee3adfe.slice/crio-f194809916e068d34ae7f9ef5417454266c287800844455007699ab9c549da4e WatchSource:0}: Error finding container f194809916e068d34ae7f9ef5417454266c287800844455007699ab9c549da4e: Status 404 returned error can't find the container with id f194809916e068d34ae7f9ef5417454266c287800844455007699ab9c549da4e
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.393685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6f5p2"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.395297    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3b458c_f93d_4ba0_a91c_fa1c90eb631c.slice/crio-23bfca533b0581361b71523915314326c0c4837934f1f0027dd55b82632ca0a2 WatchSource:0}: Error finding container 23bfca533b0581361b71523915314326c0c4837934f1f0027dd55b82632ca0a2: Status 404 returned error can't find the container with id 23bfca533b0581361b71523915314326c0c4837934f1f0027dd55b82632ca0a2
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.400011    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2zxff"
Jul 08 21:06:04.480156 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.403715    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35f8a41_02b3_483f_966f_059027f264be.slice/crio-aed414f8075ac34ac2908444fa728fdedf538e52fa6d0982148670c0624f2a55 WatchSource:0}: Error finding container aed414f8075ac34ac2908444fa728fdedf538e52fa6d0982148670c0624f2a55: Status 404 returned error can't find the container with id aed414f8075ac34ac2908444fa728fdedf538e52fa6d0982148670c0624f2a55
Jul 08 21:06:04.480947 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.404936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt"
Jul 08 21:06:04.480947 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.415292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvj8s"
Jul 08 21:06:04.480947 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.415377    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e8424e_8875_45eb_80a6_37feb009428a.slice/crio-12a2f79653124cdedc5d84efd4342273ea55680d46c56a5c31b81dabac7cce5a WatchSource:0}: Error finding container 12a2f79653124cdedc5d84efd4342273ea55680d46c56a5c31b81dabac7cce5a: Status 404 returned error can't find the container with id 12a2f79653124cdedc5d84efd4342273ea55680d46c56a5c31b81dabac7cce5a
Jul 08 21:06:04.480947 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.426966    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc19ccd_9495_48a0_87ac_9b29a0c6c369.slice/crio-4cc265b13a0894f4434816ff001a49ac0582539c37406fcb357d3eb0e6215934 WatchSource:0}: Error finding container 4cc265b13a0894f4434816ff001a49ac0582539c37406fcb357d3eb0e6215934: Status 404 returned error can't find the container with id 4cc265b13a0894f4434816ff001a49ac0582539c37406fcb357d3eb0e6215934
Jul 08 21:06:04.480947 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:04.452852    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0eb8ec_f201_4925_a4f4_eb6e0f28022a.slice/crio-61b02374a6602e729c5ea1dbd6523de4011b8fd37efadf03f638ac64a3a6b892 WatchSource:0}: Error finding container 61b02374a6602e729c5ea1dbd6523de4011b8fd37efadf03f638ac64a3a6b892: Status 404 returned error can't find the container with id 61b02374a6602e729c5ea1dbd6523de4011b8fd37efadf03f638ac64a3a6b892
Jul 08 21:06:04.777217 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.777128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:04.777217 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.777180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:04.777465 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.777302    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:04.777465 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.777309    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:04.777465 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.777367    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:06:05.777352251 +0000 UTC m=+4.029274432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:04.777465 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.777388    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:06:05.777377004 +0000 UTC m=+4.029299192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:04.878513 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:04.878474    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:04.878659 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.878612    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:04.878659 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.878629    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:04.878659 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.878640    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:04.878790 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:04.878705    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:05.878686613 +0000 UTC m=+4.130608816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:05.091581 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.091457    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:01:04 +0000 UTC" deadline="2028-04-02 19:49:26.40678243 +0000 UTC"
Jul 08 21:06:05.091581 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.091533    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15214h43m21.315254256s"
Jul 08 21:06:05.211704 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.211591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6f5p2" event={"ID":"f6615206-7688-4b36-a589-82299a33b18c","Type":"ContainerStarted","Data":"649a0559c296348531a2da5e112314960d32578f2d2f583d24e09ecad8de1009"}
Jul 08 21:06:05.217868 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.217833    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerStarted","Data":"aed414f8075ac34ac2908444fa728fdedf538e52fa6d0982148670c0624f2a55"}
Jul 08 21:06:05.222200 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.222113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fskxt" event={"ID":"df3b458c-f93d-4ba0-a91c-fa1c90eb631c","Type":"ContainerStarted","Data":"23bfca533b0581361b71523915314326c0c4837934f1f0027dd55b82632ca0a2"}
Jul 08 21:06:05.225287 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.225252    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"f194809916e068d34ae7f9ef5417454266c287800844455007699ab9c549da4e"}
Jul 08 21:06:05.233686 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.233634    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tx7p" event={"ID":"c60e3aca-7b31-4ed5-a167-a7c6401248a6","Type":"ContainerStarted","Data":"1fbd92e546e69d5cdd12c791beda02bb4ba988c2db8de2ea2abd21e3a93f8f85"}
Jul 08 21:06:05.239984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.239959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt" event={"ID":"2dc19ccd-9495-48a0-87ac-9b29a0c6c369","Type":"ContainerStarted","Data":"4cc265b13a0894f4434816ff001a49ac0582539c37406fcb357d3eb0e6215934"}
Jul 08 21:06:05.243078 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.243049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2zxff" event={"ID":"04e8424e-8875-45eb-80a6-37feb009428a","Type":"ContainerStarted","Data":"12a2f79653124cdedc5d84efd4342273ea55680d46c56a5c31b81dabac7cce5a"}
Jul 08 21:06:05.245121 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.245097    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sd2bb" event={"ID":"a236567e-f033-45c4-b129-0c0018534103","Type":"ContainerStarted","Data":"9f74419ee85b19e8d92b6cc7c604c80f46db07e3f37df4b1cd704b1cc7e907be"}
Jul 08 21:06:05.249426 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.249400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvj8s" event={"ID":"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a","Type":"ContainerStarted","Data":"61b02374a6602e729c5ea1dbd6523de4011b8fd37efadf03f638ac64a3a6b892"}
Jul 08 21:06:05.786855 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.786752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:05.786855 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.786817    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:05.787264 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.786998    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:05.787264 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.787063    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:06:07.787044548 +0000 UTC m=+6.038966745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:05.787530 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.787509    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:05.787605 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.787594    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:06:07.787553522 +0000 UTC m=+6.039475720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:05.887897 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:05.887855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:05.888108 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.888096    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:05.888178 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.888120    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:05.888178 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.888135    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:05.888284 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:05.888202    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:07.888182386 +0000 UTC m=+6.140104597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:06.092051 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:06.091954    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 21:01:04 +0000 UTC" deadline="2028-02-22 22:37:55.710602497 +0000 UTC"
Jul 08 21:06:06.092051 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:06.091998    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14257h31m49.618609846s"
Jul 08 21:06:06.200565 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:06.200533    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:06.200747 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:06.200674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:06.201143 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:06.201122    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:06.201280 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:06.201240    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:06.203574 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:06.203551    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:06.203691 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:06.203662    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:07.803834 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:07.803790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:07.804384 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:07.803861    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:07.804384 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.804014    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:07.804384 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.804085    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:06:11.804062649 +0000 UTC m=+10.055984847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:07.804638 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.804567    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:07.804638 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.804637    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:06:11.804618561 +0000 UTC m=+10.056540747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:07.905002 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:07.904961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:07.905223 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.905203    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:07.905305 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.905227    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:07.905305 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.905246    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:07.905417 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:07.905311    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:11.905291845 +0000 UTC m=+10.157214030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:08.200141 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:08.200036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:08.200141 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:08.200077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:08.200394 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:08.200036    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:08.200394 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:08.200212    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:08.200515 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:08.200371    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:08.200515 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:08.200496    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:10.200652 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:10.199631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:10.200652 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:10.199974    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:10.200652 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:10.200497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:10.200652 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:10.200604    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:10.201373 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:10.201348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:10.201488 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:10.201452    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:11.838495 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:11.838437    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:11.839004 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:11.838555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:11.839004 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.838702    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:11.839004 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.838770    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:06:19.83874979 +0000 UTC m=+18.090671993 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:11.839004 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.838988    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:11.839243 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.839060    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:06:19.839041109 +0000 UTC m=+18.090963296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:11.939206 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:11.939167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:11.939422 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.939406    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:11.939500 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.939430    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:11.939500 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.939445    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:11.939600 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:11.939503    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:19.939485428 +0000 UTC m=+18.191407612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:12.200668 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:12.200484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:12.200668 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:12.200587    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:12.200668 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:12.200636    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:12.200944 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:12.200756    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:12.200944 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:12.200808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:12.200944 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:12.200881    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:14.199915 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:14.199870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:14.200407 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:14.199870    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:14.200407 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:14.199999    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:14.200407 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:14.200027    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:14.200407 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:14.200197    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:14.200407 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:14.200301    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:16.200143 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:16.200094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:16.200143 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:16.200121    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:16.200677 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:16.200239    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:16.200677 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:16.200305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:16.200677 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:16.200416    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:16.200677 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:16.200517    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:18.199632 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:18.199597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:18.200095 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:18.199644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:18.200095 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:18.199598    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:18.200095 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:18.199718    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:18.200095 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:18.199825    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:18.200095 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:18.199908    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:19.898079 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:19.897987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:19.898079 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:19.898044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:19.898623 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.898161    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:19.898623 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.898217    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:06:35.898203857 +0000 UTC m=+34.150126036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:19.898623 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.898162    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:19.898623 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.898348    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:06:35.898323416 +0000 UTC m=+34.150245606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:19.999417 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:19.999360    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:19.999590 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.999546    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:19.999590 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.999575    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:19.999590 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.999588    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:19.999712 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:19.999641    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:35.999625306 +0000 UTC m=+34.251547488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:20.200241 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:20.200161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:20.200390 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:20.200174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:20.200390 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:20.200297    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:20.200390 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:20.200174    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:20.200485 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:20.200381    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:20.200523 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:20.200486    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:22.200082 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:22.200044    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:22.200601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:22.200145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:22.200601 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:22.200157    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:22.200601 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:22.200272    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:22.200601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:22.200328    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:22.200601 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:22.200419    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:24.200097 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.200041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:24.200097 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.200094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:24.200598 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:24.200198    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:24.200598 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.200253    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:24.200598 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:24.200348    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:24.201558 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:24.201525    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:24.294340 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.294067    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal" event={"ID":"07d1f4d49abf1d7933a9ae700ae56fff","Type":"ContainerStarted","Data":"36206a2f02762a2bff7cc957b7f9b13740d3dbfbbdd98d2c4c509772e396e6f2"}
Jul 08 21:06:24.304587 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.303963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tx7p" event={"ID":"c60e3aca-7b31-4ed5-a167-a7c6401248a6","Type":"ContainerStarted","Data":"67006c3108dc9b1784412def4e69349d960fdea4c8cb4dd2a6b05f020b8b9660"}
Jul 08 21:06:24.308120 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.308055    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-192.ec2.internal" podStartSLOduration=21.30803649 podStartE2EDuration="21.30803649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:24.306725162 +0000 UTC m=+22.558647367" watchObservedRunningTime="2026-07-08 21:06:24.30803649 +0000 UTC m=+22.559958693"
Jul 08 21:06:24.312952 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.312871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2zxff" event={"ID":"04e8424e-8875-45eb-80a6-37feb009428a","Type":"ContainerStarted","Data":"872c42c81bb0a5e8d0a3fe0f38969bdc7c7ff43241061e1ec9516022c47a7dc7"}
Jul 08 21:06:24.342489 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:24.342430    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2tx7p" podStartSLOduration=2.66272016 podStartE2EDuration="22.342405931s" totalImagesPullingTime="19.679685771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:24.325064572 +0000 UTC m=+22.576986774" watchObservedRunningTime="2026-07-08 21:06:24.342405931 +0000 UTC m=+22.594328137"
Jul 08 21:06:25.317675 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.317342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"35b001b02b4f125a5144d6a3b18a41f30b22f2a56a3933c1091ca19f9003aada"}
Jul 08 21:06:25.317675 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.317644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"9de3c7a38276b0fbb59a84297533792f004fae3b85f3c95a348b79a72fe77c0b"}
Jul 08 21:06:25.318536 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.317693    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"aa8a70d04af3504afcaaeb879373e94c5771ad9b8d3bb300c3876f0c3b91b13f"}
Jul 08 21:06:25.318536 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.317734    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"5c0c1bb8f4def6c59fcd512e342b5667315847f701e7f3f06fd1efc50108084d"}
Jul 08 21:06:25.318536 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.317774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"32c738c55ee2496ee73b4d0c684d9f6008a0e00bde72e709e0205b8b9bfe1c1c"}
Jul 08 21:06:25.318536 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.317811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"4cc249c5268a63a229e75302715010554a1e6bde58da35c66d840ee9cec85e23"}
Jul 08 21:06:25.318859 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.318839    2560 generic.go:356] "Generic (PLEG): container finished" podID="1b623bc6e3b3aed560be61f090f5a652" containerID="e5dd1985834e1bcc24a5cee500983e3a0808dbfd48e2ac138e056ab30d0f4ca9" exitCode=0
Jul 08 21:06:25.318923 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.318908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal" event={"ID":"1b623bc6e3b3aed560be61f090f5a652","Type":"ContainerDied","Data":"e5dd1985834e1bcc24a5cee500983e3a0808dbfd48e2ac138e056ab30d0f4ca9"}
Jul 08 21:06:25.320411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.320382    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt" event={"ID":"2dc19ccd-9495-48a0-87ac-9b29a0c6c369","Type":"ContainerStarted","Data":"ec2e0a7365d2fcd3f206a85f463ee89b5c90ec0f48a7736d4d33c6bc66b59988"}
Jul 08 21:06:25.321740 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.321720    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sd2bb" event={"ID":"a236567e-f033-45c4-b129-0c0018534103","Type":"ContainerStarted","Data":"1eac4a68b697b25b765876256adf29f03ae9a2990a11cb45e9be39479e0b79a7"}
Jul 08 21:06:25.323061 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.323043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6f5p2" event={"ID":"f6615206-7688-4b36-a589-82299a33b18c","Type":"ContainerStarted","Data":"33ce3adfb10c299b7bf19b43be773b7ed358a2b7b1ddd10c28cc6c12e5df44b0"}
Jul 08 21:06:25.324437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.324417    2560 generic.go:356] "Generic (PLEG): container finished" podID="a35f8a41-02b3-483f-966f-059027f264be" containerID="c08f995f157fd60f16dd52da1ce825ea9e66c6b028a6d83590754d3175277220" exitCode=0
Jul 08 21:06:25.324527 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.324496    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerDied","Data":"c08f995f157fd60f16dd52da1ce825ea9e66c6b028a6d83590754d3175277220"}
Jul 08 21:06:25.325862 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.325840    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fskxt" event={"ID":"df3b458c-f93d-4ba0-a91c-fa1c90eb631c","Type":"ContainerStarted","Data":"eb298a3fa2e8101a128a286cfc792a567b2d087170de4a6454ccf717626b75f3"}
Jul 08 21:06:25.334727 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.334685    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2zxff" podStartSLOduration=3.711570964 podStartE2EDuration="23.334672462s" totalImagesPullingTime="19.623101498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:24.343409923 +0000 UTC m=+22.595332125" watchObservedRunningTime="2026-07-08 21:06:25.334672462 +0000 UTC m=+23.586594663"
Jul 08 21:06:25.346191 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.346113    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sd2bb" podStartSLOduration=3.668549853 podStartE2EDuration="23.346101243s" totalImagesPullingTime="19.67755139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:25.346021635 +0000 UTC m=+23.597943837" watchObservedRunningTime="2026-07-08 21:06:25.346101243 +0000 UTC m=+23.598023444"
Jul 08 21:06:25.360408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.359036    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fskxt" podStartSLOduration=8.25939041 podStartE2EDuration="23.359018863s" totalImagesPullingTime="15.099628453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:25.357927918 +0000 UTC m=+23.609850121" watchObservedRunningTime="2026-07-08 21:06:25.359018863 +0000 UTC m=+23.610941043"
Jul 08 21:06:25.392314 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:25.392261    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6f5p2" podStartSLOduration=12.248304225 podStartE2EDuration="23.392242884s" totalImagesPullingTime="11.143938659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:25.391624338 +0000 UTC m=+23.643546540" watchObservedRunningTime="2026-07-08 21:06:25.392242884 +0000 UTC m=+23.644165087"
Jul 08 21:06:26.199628 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.199594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:26.199851 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.199594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:26.199851 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:26.199733    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:26.199851 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:26.199795    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:26.199851 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.199594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:26.200051 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:26.199897    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:26.330521 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.330483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal" event={"ID":"1b623bc6e3b3aed560be61f090f5a652","Type":"ContainerStarted","Data":"950a06e18e2838e6ab0cd3e4a3cf2d6e5825c08ed80be578a540651ca4af6280"}
Jul 08 21:06:26.332237 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.332129    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvj8s" event={"ID":"9b0eb8ec-f201-4925-a4f4-eb6e0f28022a","Type":"ContainerStarted","Data":"a8c10c8b96e3530e68906246f548a0dfca331e191ac59494977f09af2bcf966e"}
Jul 08 21:06:26.345233 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.345181    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-192.ec2.internal" podStartSLOduration=23.345167723 podStartE2EDuration="23.345167723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:26.344919283 +0000 UTC m=+24.596841486" watchObservedRunningTime="2026-07-08 21:06:26.345167723 +0000 UTC m=+24.597089924"
Jul 08 21:06:26.358503 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.358462    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nvj8s" podStartSLOduration=3.768232899 podStartE2EDuration="23.358451759s" totalImagesPullingTime="19.59021886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:26.358077375 +0000 UTC m=+24.609999578" watchObservedRunningTime="2026-07-08 21:06:26.358451759 +0000 UTC m=+24.610373960"
Jul 08 21:06:26.567792 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.567757    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:26.568480 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.568455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:26.671218 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:26.671192    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 21:06:27.129583 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.129479    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T21:06:26.671211393Z","UUID":"bf988b35-050f-4f1b-991c-414e723fed5e","Handler":null,"Name":"","Endpoint":""}
Jul 08 21:06:27.132458 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.132442    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 21:06:27.132576 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.132481    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 21:06:27.338160 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.338074    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt" event={"ID":"2dc19ccd-9495-48a0-87ac-9b29a0c6c369","Type":"ContainerStarted","Data":"4acf5edbca980f404a1b8a7dd3aa1fe604f7009392d504d0518c906bdfba36d0"}
Jul 08 21:06:27.343609 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.343568    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"bea321504c3e6559ab79ec33d17d218c9d09acf771603ab452b8ad3174825967"}
Jul 08 21:06:27.343764 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.343661    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:27.344042 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:27.344020    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fskxt"
Jul 08 21:06:28.200203 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:28.200167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:28.200400 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:28.200167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:28.200400 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:28.200321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:28.200530 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:28.200302    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:28.200530 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:28.200421    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:28.200530 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:28.200504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:28.347899 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:28.347809    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt" event={"ID":"2dc19ccd-9495-48a0-87ac-9b29a0c6c369","Type":"ContainerStarted","Data":"99419725ee1bb329fe5fb56583bf25c7cef8d43ad2ad08146828a931afd425ce"}
Jul 08 21:06:28.364546 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:28.364493    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kcwjt" podStartSLOduration=2.7735797189999998 podStartE2EDuration="25.364476504s" totalImagesPullingTime="22.590896785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:28.364109853 +0000 UTC m=+26.616032055" watchObservedRunningTime="2026-07-08 21:06:28.364476504 +0000 UTC m=+26.616398706"
Jul 08 21:06:30.199897 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.199678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:30.200621 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.199678    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:30.200621 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:30.199926    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:30.200621 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.199703    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:30.200621 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:30.199997    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:30.200621 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:30.200070    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:30.357640 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.357604    2560 generic.go:356] "Generic (PLEG): container finished" podID="a35f8a41-02b3-483f-966f-059027f264be" containerID="ffd3ee2a479f09036adbc87d0a39fd75a9093dc057c27b19a503cc27a6e9bbf6" exitCode=0
Jul 08 21:06:30.357830 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.357648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerDied","Data":"ffd3ee2a479f09036adbc87d0a39fd75a9093dc057c27b19a503cc27a6e9bbf6"}
Jul 08 21:06:30.361322 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.361294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" event={"ID":"16489f09-9fd1-4e1b-a06e-c52f0ee3adfe","Type":"ContainerStarted","Data":"5d5db19e6b1c721c2100671b9f63b8f9e17323144cd25c2d55558642c63247bc"}
Jul 08 21:06:30.361603 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.361580    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:30.361714 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.361634    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:30.361714 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.361667    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:30.377668 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.377492    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:30.377811 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.377757    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:06:30.399111 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:30.399056    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4" podStartSLOduration=8.571336063 podStartE2EDuration="28.399040273s" totalImagesPullingTime="19.82770421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:30.397891088 +0000 UTC m=+28.649813291" watchObservedRunningTime="2026-07-08 21:06:30.399040273 +0000 UTC m=+28.650962474"
Jul 08 21:06:31.676512 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:31.676408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rf9mk"]
Jul 08 21:06:31.676994 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:31.676539    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:31.676994 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:31.676623    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:31.680098 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:31.680070    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b62pz"]
Jul 08 21:06:31.680283 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:31.680179    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:31.680283 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:31.680274    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:31.680803 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:31.680778    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rnk9k"]
Jul 08 21:06:31.680910 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:31.680877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:31.680979 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:31.680963    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:32.367694 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:32.367652    2560 generic.go:356] "Generic (PLEG): container finished" podID="a35f8a41-02b3-483f-966f-059027f264be" containerID="ed69a3b1b84822634c5ba675676719d1c4d3028f394d66aa47ffe2539f571d9b" exitCode=0
Jul 08 21:06:32.367851 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:32.367753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerDied","Data":"ed69a3b1b84822634c5ba675676719d1c4d3028f394d66aa47ffe2539f571d9b"}
Jul 08 21:06:33.199337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:33.199300    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:33.199733 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:33.199426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:33.199733 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:33.199433    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:33.199733 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:33.199454    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:33.199733 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:33.199533    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:33.199733 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:33.199586    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:34.374320 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:34.374144    2560 generic.go:356] "Generic (PLEG): container finished" podID="a35f8a41-02b3-483f-966f-059027f264be" containerID="7c31b12973f257e9b03bb610d1934ccd84267c92b35a93f46a563fb664b7a303" exitCode=0
Jul 08 21:06:34.374320 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:34.374237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerDied","Data":"7c31b12973f257e9b03bb610d1934ccd84267c92b35a93f46a563fb664b7a303"}
Jul 08 21:06:35.199429 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:35.199393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:35.199582 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:35.199499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:35.199640 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.199588    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rf9mk" podUID="929107c5-2a8f-4b78-a122-f520b854d124"
Jul 08 21:06:35.199640 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.199504    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b62pz" podUID="bb148e1a-fbe6-44da-b3f1-b542e6f57fca"
Jul 08 21:06:35.199640 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:35.199504    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:35.199734 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.199674    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:06:35.918825 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:35.918789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:35.919395 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:35.918836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:35.919395 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.918949    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:35.919395 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.918951    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:35.919395 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.919014    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret podName:bb148e1a-fbe6-44da-b3f1-b542e6f57fca nodeName:}" failed. No retries permitted until 2026-07-08 21:07:07.918987759 +0000 UTC m=+66.170909956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret") pod "global-pull-secret-syncer-b62pz" (UID: "bb148e1a-fbe6-44da-b3f1-b542e6f57fca") : object "kube-system"/"original-pull-secret" not registered
Jul 08 21:06:35.919395 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:35.919028    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:07:07.91902213 +0000 UTC m=+66.170944310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 21:06:36.019639 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:36.019581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:36.019819 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:36.019773    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 21:06:36.019819 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:36.019796    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 21:06:36.019819 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:36.019810    2560 projected.go:196] Error preparing data for projected volume kube-api-access-nkxf2 for pod openshift-network-diagnostics/network-check-target-rf9mk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:36.019956 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:36.019873    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2 podName:929107c5-2a8f-4b78-a122-f520b854d124 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:08.019857543 +0000 UTC m=+66.271779736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nkxf2" (UniqueName: "kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2") pod "network-check-target-rf9mk" (UID: "929107c5-2a8f-4b78-a122-f520b854d124") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 21:06:37.116273 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.116246    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-192.ec2.internal" event="NodeReady"
Jul 08 21:06:37.116837 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.116415    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 21:06:37.154355 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.154329    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7t2x7"]
Jul 08 21:06:37.156126 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.156111    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.157134 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.157110    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gvwfb"]
Jul 08 21:06:37.158461 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.158445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.158720 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.158694    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 21:06:37.158837 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.158696    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ltsxq\""
Jul 08 21:06:37.158837 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.158831    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 21:06:37.160589 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.160569    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vg9kt\""
Jul 08 21:06:37.160727 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.160713    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 21:06:37.160882 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.160864    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 21:06:37.161103 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.161088    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 21:06:37.166478 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.166459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7t2x7"]
Jul 08 21:06:37.169243 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.169188    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gvwfb"]
Jul 08 21:06:37.199329 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.199296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:06:37.199500 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.199335    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:06:37.199500 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.199419    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:06:37.201486 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.201469    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:06:37.201750 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.201726    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:06:37.201871 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.201816    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fk5xk\""
Jul 08 21:06:37.201941 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.201882    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfx9c\""
Jul 08 21:06:37.201941 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.201819    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:06:37.201941 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.201926    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:06:37.329650 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.329601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6c9t\" (UniqueName: \"kubernetes.io/projected/73cb0101-875e-4108-b4dd-d9618bcfd9ce-kube-api-access-c6c9t\") pod \"ingress-canary-gvwfb\" (UID: \"73cb0101-875e-4108-b4dd-d9618bcfd9ce\") " pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.329835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.329666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73cb0101-875e-4108-b4dd-d9618bcfd9ce-cert\") pod \"ingress-canary-gvwfb\" (UID: \"73cb0101-875e-4108-b4dd-d9618bcfd9ce\") " pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.329835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.329695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cfb69ae-b74c-400c-a273-35b9927a0142-config-volume\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.329835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.329720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpz2f\" (UniqueName: \"kubernetes.io/projected/4cfb69ae-b74c-400c-a273-35b9927a0142-kube-api-access-zpz2f\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.329835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.329761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cfb69ae-b74c-400c-a273-35b9927a0142-tmp-dir\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.329835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.329804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.430474 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6c9t\" (UniqueName: \"kubernetes.io/projected/73cb0101-875e-4108-b4dd-d9618bcfd9ce-kube-api-access-c6c9t\") pod \"ingress-canary-gvwfb\" (UID: \"73cb0101-875e-4108-b4dd-d9618bcfd9ce\") " pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.430474 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430426    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73cb0101-875e-4108-b4dd-d9618bcfd9ce-cert\") pod \"ingress-canary-gvwfb\" (UID: \"73cb0101-875e-4108-b4dd-d9618bcfd9ce\") " pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.430474 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cfb69ae-b74c-400c-a273-35b9927a0142-config-volume\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.430736 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430515    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpz2f\" (UniqueName: \"kubernetes.io/projected/4cfb69ae-b74c-400c-a273-35b9927a0142-kube-api-access-zpz2f\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.430736 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cfb69ae-b74c-400c-a273-35b9927a0142-tmp-dir\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.430736 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430637    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.430843 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:37.430746    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:37.430843 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:37.430803    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:37.930786878 +0000 UTC m=+36.182709073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:37.430924 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.430903    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cfb69ae-b74c-400c-a273-35b9927a0142-tmp-dir\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.431091 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.431076    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cfb69ae-b74c-400c-a273-35b9927a0142-config-volume\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.434593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.434574    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73cb0101-875e-4108-b4dd-d9618bcfd9ce-cert\") pod \"ingress-canary-gvwfb\" (UID: \"73cb0101-875e-4108-b4dd-d9618bcfd9ce\") " pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.438748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.438728    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpz2f\" (UniqueName: \"kubernetes.io/projected/4cfb69ae-b74c-400c-a273-35b9927a0142-kube-api-access-zpz2f\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.439445 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.439427    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6c9t\" (UniqueName: \"kubernetes.io/projected/73cb0101-875e-4108-b4dd-d9618bcfd9ce-kube-api-access-c6c9t\") pod \"ingress-canary-gvwfb\" (UID: \"73cb0101-875e-4108-b4dd-d9618bcfd9ce\") " pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.471535 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.471503    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gvwfb"
Jul 08 21:06:37.616148 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.616119    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gvwfb"]
Jul 08 21:06:37.620315 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:06:37.620106    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cb0101_875e_4108_b4dd_d9618bcfd9ce.slice/crio-6a7ae038a5bde854155ffb8464b42aa4e5a1471a7291df6bcd25e8d06a3cac65 WatchSource:0}: Error finding container 6a7ae038a5bde854155ffb8464b42aa4e5a1471a7291df6bcd25e8d06a3cac65: Status 404 returned error can't find the container with id 6a7ae038a5bde854155ffb8464b42aa4e5a1471a7291df6bcd25e8d06a3cac65
Jul 08 21:06:37.933049 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:37.933017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:37.933221 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:37.933170    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:37.933262 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:37.933228    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:38.93321237 +0000 UTC m=+37.185134549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:38.385823 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:38.385784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gvwfb" event={"ID":"73cb0101-875e-4108-b4dd-d9618bcfd9ce","Type":"ContainerStarted","Data":"6a7ae038a5bde854155ffb8464b42aa4e5a1471a7291df6bcd25e8d06a3cac65"}
Jul 08 21:06:38.942178 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:38.942147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:38.942394 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:38.942335    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:38.942458 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:38.942431    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:40.942410594 +0000 UTC m=+39.194332778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:40.958951 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:40.958913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:40.959411 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:40.959085    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:40.959411 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:40.959161    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:44.959140091 +0000 UTC m=+43.211062294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:42.395971 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:42.395934    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gvwfb" event={"ID":"73cb0101-875e-4108-b4dd-d9618bcfd9ce","Type":"ContainerStarted","Data":"f0e4a1d5c5e27969d1d89cf6f52cc4dfea49aea6b813b8e2704b79f4ef6800e5"}
Jul 08 21:06:42.398594 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:42.398566    2560 generic.go:356] "Generic (PLEG): container finished" podID="a35f8a41-02b3-483f-966f-059027f264be" containerID="f58a8b46c97abb648f5ccb6b18435436c194f1cc94d21e8e43f6acfbd5496b57" exitCode=0
Jul 08 21:06:42.398724 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:42.398620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerDied","Data":"f58a8b46c97abb648f5ccb6b18435436c194f1cc94d21e8e43f6acfbd5496b57"}
Jul 08 21:06:42.409706 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:42.409658    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gvwfb" podStartSLOduration=1.5907604819999999 podStartE2EDuration="5.409642096s" totalImagesPullingTime="3.818881614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:42.409148448 +0000 UTC m=+40.661070649" watchObservedRunningTime="2026-07-08 21:06:42.409642096 +0000 UTC m=+40.661564298"
Jul 08 21:06:43.404040 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:43.403997    2560 generic.go:356] "Generic (PLEG): container finished" podID="a35f8a41-02b3-483f-966f-059027f264be" containerID="f0a2b75e92ce57c232d24ec5ba75025b60e601252fc2c134d4968af590750cd6" exitCode=0
Jul 08 21:06:43.404414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:43.404060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerDied","Data":"f0a2b75e92ce57c232d24ec5ba75025b60e601252fc2c134d4968af590750cd6"}
Jul 08 21:06:44.409306 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:44.409271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dq52g" event={"ID":"a35f8a41-02b3-483f-966f-059027f264be","Type":"ContainerStarted","Data":"ffe81ac24f839d377b07e58bb2993f4a3334091724c0b06354e3a037becb6415"}
Jul 08 21:06:44.430091 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:44.430039    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dq52g" podStartSLOduration=9.605077274 podStartE2EDuration="42.43002406s" totalImagesPullingTime="32.824946786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:06:44.428210264 +0000 UTC m=+42.680132467" watchObservedRunningTime="2026-07-08 21:06:44.43002406 +0000 UTC m=+42.681946261"
Jul 08 21:06:44.987866 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:44.987825    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:44.988014 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:44.987971    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:44.988072 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:44.988038    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:06:52.988019648 +0000 UTC m=+51.239941831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:06:53.044594 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:06:53.044557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:06:53.045045 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:53.044712    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:06:53.045045 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:06:53.044805    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:09.044786306 +0000 UTC m=+67.296708490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:02.381537 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:02.381509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mxnx4"
Jul 08 21:07:07.949280 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:07.949239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:07:07.949280 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:07.949287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:07:07.951905 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:07.951886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 21:07:07.951985 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:07.951951    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 21:07:07.959831 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:07:07.959814    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:07:07.959898 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:07:07.959884    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:08:11.959863231 +0000 UTC m=+130.211785421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : secret "metrics-daemon-secret" not found
Jul 08 21:07:07.962804 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:07.962785    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb148e1a-fbe6-44da-b3f1-b542e6f57fca-original-pull-secret\") pod \"global-pull-secret-syncer-b62pz\" (UID: \"bb148e1a-fbe6-44da-b3f1-b542e6f57fca\") " pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:07:08.049759 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.049719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:07:08.052276 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.052258    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 21:07:08.061989 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.061970    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 21:07:08.073159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.073131    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxf2\" (UniqueName: \"kubernetes.io/projected/929107c5-2a8f-4b78-a122-f520b854d124-kube-api-access-nkxf2\") pod \"network-check-target-rf9mk\" (UID: \"929107c5-2a8f-4b78-a122-f520b854d124\") " pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:07:08.111533 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.111509    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fk5xk\""
Jul 08 21:07:08.118500 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.118483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b62pz"
Jul 08 21:07:08.119566 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.119548    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:07:08.247847 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.247813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rf9mk"]
Jul 08 21:07:08.250866 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:07:08.250837    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929107c5_2a8f_4b78_a122_f520b854d124.slice/crio-b41200534b18fd300eb92d380d6746fd5120f6c504682a361ca160c800d3b588 WatchSource:0}: Error finding container b41200534b18fd300eb92d380d6746fd5120f6c504682a361ca160c800d3b588: Status 404 returned error can't find the container with id b41200534b18fd300eb92d380d6746fd5120f6c504682a361ca160c800d3b588
Jul 08 21:07:08.260592 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.260572    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b62pz"]
Jul 08 21:07:08.263394 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:07:08.263358    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb148e1a_fbe6_44da_b3f1_b542e6f57fca.slice/crio-fd8b1bc9bddd8b7013652792ddf761ce27ef675b13a694e5100a904f3668a168 WatchSource:0}: Error finding container fd8b1bc9bddd8b7013652792ddf761ce27ef675b13a694e5100a904f3668a168: Status 404 returned error can't find the container with id fd8b1bc9bddd8b7013652792ddf761ce27ef675b13a694e5100a904f3668a168
Jul 08 21:07:08.469670 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.469578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rf9mk" event={"ID":"929107c5-2a8f-4b78-a122-f520b854d124","Type":"ContainerStarted","Data":"b41200534b18fd300eb92d380d6746fd5120f6c504682a361ca160c800d3b588"}
Jul 08 21:07:08.470596 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:08.470564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b62pz" event={"ID":"bb148e1a-fbe6-44da-b3f1-b542e6f57fca","Type":"ContainerStarted","Data":"fd8b1bc9bddd8b7013652792ddf761ce27ef675b13a694e5100a904f3668a168"}
Jul 08 21:07:09.059111 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:09.059067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:07:09.059535 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:07:09.059223    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:07:09.059535 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:07:09.059292    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:07:41.059271185 +0000 UTC m=+99.311193366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:13.485800 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:13.485714    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rf9mk" event={"ID":"929107c5-2a8f-4b78-a122-f520b854d124","Type":"ContainerStarted","Data":"6cc78c7cfded4ae4f4eb196bba1c1a701f560bbcacf92f9ac280411e9543014d"}
Jul 08 21:07:13.486244 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:13.485841    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:07:13.487273 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:13.487248    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b62pz" event={"ID":"bb148e1a-fbe6-44da-b3f1-b542e6f57fca","Type":"ContainerStarted","Data":"afe1f359f50c00a292eb70aeaee013a19927f8463113385495f1acda90f311ad"}
Jul 08 21:07:13.499358 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:13.499322    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rf9mk" podStartSLOduration=66.569596459 podStartE2EDuration="1m11.499310722s" totalImagesPullingTime="4.929714263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:13.499095332 +0000 UTC m=+71.751017534" watchObservedRunningTime="2026-07-08 21:07:13.499310722 +0000 UTC m=+71.751232923"
Jul 08 21:07:39.801163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.801101    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b62pz" podStartSLOduration=91.879269174 podStartE2EDuration="1m36.801081324s" totalImagesPullingTime="4.92181215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:13.511417884 +0000 UTC m=+71.763340087" watchObservedRunningTime="2026-07-08 21:07:39.801081324 +0000 UTC m=+98.053003525"
Jul 08 21:07:39.801597 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.801466    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"]
Jul 08 21:07:39.805825 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.805808    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.808151 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.808124    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 21:07:39.808279 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.808125    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 21:07:39.808279 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.808133    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 21:07:39.809210 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.809195    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 21:07:39.812608 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.812589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"]
Jul 08 21:07:39.873259 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.873224    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd47f11-2c28-4372-8072-1d23d2edc971-tmp\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.873417 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.873323    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drs7n\" (UniqueName: \"kubernetes.io/projected/ffd47f11-2c28-4372-8072-1d23d2edc971-kube-api-access-drs7n\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.873417 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.873349    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ffd47f11-2c28-4372-8072-1d23d2edc971-klusterlet-config\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.973661 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.973591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drs7n\" (UniqueName: \"kubernetes.io/projected/ffd47f11-2c28-4372-8072-1d23d2edc971-kube-api-access-drs7n\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.973661 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.973664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ffd47f11-2c28-4372-8072-1d23d2edc971-klusterlet-config\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.973900 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.973683    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd47f11-2c28-4372-8072-1d23d2edc971-tmp\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.974065 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.974048    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd47f11-2c28-4372-8072-1d23d2edc971-tmp\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.976111 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.976087    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ffd47f11-2c28-4372-8072-1d23d2edc971-klusterlet-config\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:39.981624 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:39.981603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drs7n\" (UniqueName: \"kubernetes.io/projected/ffd47f11-2c28-4372-8072-1d23d2edc971-kube-api-access-drs7n\") pod \"klusterlet-addon-workmgr-75997788b8-p2tdn\" (UID: \"ffd47f11-2c28-4372-8072-1d23d2edc971\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:40.116051 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:40.116004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:40.236097 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:40.236066    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"]
Jul 08 21:07:40.239668 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:07:40.239641    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd47f11_2c28_4372_8072_1d23d2edc971.slice/crio-3e368bf1f1b1bbe28a942973746c1d94729ab659d38812dab6c80e994d727f48 WatchSource:0}: Error finding container 3e368bf1f1b1bbe28a942973746c1d94729ab659d38812dab6c80e994d727f48: Status 404 returned error can't find the container with id 3e368bf1f1b1bbe28a942973746c1d94729ab659d38812dab6c80e994d727f48
Jul 08 21:07:40.553754 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:40.553660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn" event={"ID":"ffd47f11-2c28-4372-8072-1d23d2edc971","Type":"ContainerStarted","Data":"3e368bf1f1b1bbe28a942973746c1d94729ab659d38812dab6c80e994d727f48"}
Jul 08 21:07:41.083174 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:41.083128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:07:41.083663 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:07:41.083306    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:07:41.083663 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:07:41.083422    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:08:45.083400856 +0000 UTC m=+163.335323036 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:07:44.493061 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:44.493027    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rf9mk"
Jul 08 21:07:46.569711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:46.569674    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn" event={"ID":"ffd47f11-2c28-4372-8072-1d23d2edc971","Type":"ContainerStarted","Data":"366059faeaa563aed615927387b4f2eb48c0887659110ec10e6a81beda1774bb"}
Jul 08 21:07:46.570212 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:46.569873    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:46.571331 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:46.571312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:07:46.600333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:07:46.600288    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn" podStartSLOduration=1.982493345 podStartE2EDuration="7.600275805s" totalImagesPullingTime="5.61778246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:07:46.586681015 +0000 UTC m=+104.838603217" watchObservedRunningTime="2026-07-08 21:07:46.600275805 +0000 UTC m=+104.852198006"
Jul 08 21:08:11.986931 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:08:11.986878    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:08:11.987543 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:08:11.987048    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:08:11.987543 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:08:11.987139    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:10:13.987117226 +0000 UTC m=+252.239039428 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : secret "metrics-daemon-secret" not found
Jul 08 21:08:40.166572 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:08:40.166506    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7t2x7" podUID="4cfb69ae-b74c-400c-a273-35b9927a0142"
Jul 08 21:08:40.214009 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:08:40.213971    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:08:40.704809 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:08:40.704780    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:08:45.121687 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:08:45.121638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:08:45.122121 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:08:45.121764    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 21:08:45.122121 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:08:45.121828    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls podName:4cfb69ae-b74c-400c-a273-35b9927a0142 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:47.121814584 +0000 UTC m=+285.373736764 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls") pod "dns-default-7t2x7" (UID: "4cfb69ae-b74c-400c-a273-35b9927a0142") : secret "dns-default-metrics-tls" not found
Jul 08 21:08:54.200107 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:08:54.200022    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:09:46.570320 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:46.570258    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn" podUID="ffd47f11-2c28-4372-8072-1d23d2edc971" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused"
Jul 08 21:09:46.864273 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:46.864241    2560 generic.go:356] "Generic (PLEG): container finished" podID="ffd47f11-2c28-4372-8072-1d23d2edc971" containerID="366059faeaa563aed615927387b4f2eb48c0887659110ec10e6a81beda1774bb" exitCode=1
Jul 08 21:09:46.864452 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:46.864314    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn" event={"ID":"ffd47f11-2c28-4372-8072-1d23d2edc971","Type":"ContainerDied","Data":"366059faeaa563aed615927387b4f2eb48c0887659110ec10e6a81beda1774bb"}
Jul 08 21:09:46.864638 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:46.864626    2560 scope.go:117] "RemoveContainer" containerID="366059faeaa563aed615927387b4f2eb48c0887659110ec10e6a81beda1774bb"
Jul 08 21:09:47.868097 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:47.868062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn" event={"ID":"ffd47f11-2c28-4372-8072-1d23d2edc971","Type":"ContainerStarted","Data":"94facaf9a74bf69e0a307ee4abd8f5708dcd6a28b85fb3a811e4d6c4bc409441"}
Jul 08 21:09:47.868484 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:47.868345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:09:47.868955 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:47.868932    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75997788b8-p2tdn"
Jul 08 21:09:58.506314 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.506278    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5989d4555-zt8h6"]
Jul 08 21:09:58.512650 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.512627    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.515093 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.515071    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 21:09:58.515490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.515476    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 21:09:58.515556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.515541    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 21:09:58.515753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.515737    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 21:09:58.515809 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.515737    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 21:09:58.515809 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.515793    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 21:09:58.516336 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.516316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ftnmf\""
Jul 08 21:09:58.528751 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.528727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5989d4555-zt8h6"]
Jul 08 21:09:58.610487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.610446    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"]
Jul 08 21:09:58.613531 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.613514    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"]
Jul 08 21:09:58.613659 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.613645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.616213 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.616193    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.616310 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.616235    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 08 21:09:58.616310 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.616290    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:09:58.616720 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.616700    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 08 21:09:58.616802 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.616775    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 08 21:09:58.616907 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.616891    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mcm5p\""
Jul 08 21:09:58.619059 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.619039    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 21:09:58.619166 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.619094    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 08 21:09:58.619269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.619243    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w2rrd\""
Jul 08 21:09:58.620682 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.620662    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 08 21:09:58.620682 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.620662    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 21:09:58.624466 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.624443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"]
Jul 08 21:09:58.625228 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.625207    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"]
Jul 08 21:09:58.630263 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.630242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftwt6\" (UniqueName: \"kubernetes.io/projected/41ccbe14-5f86-4d32-9542-70effc085712-kube-api-access-ftwt6\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.630395 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.630275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-default-certificate\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.630395 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.630297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.630395 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.630346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.630530 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.630405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-stats-auth\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.698820 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.698785    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6498c7b5bb-6wbrc"]
Jul 08 21:09:58.701783 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.701767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.704359 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.704337    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 21:09:58.704476 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.704401    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 21:09:58.704476 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.704423    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 21:09:58.704581 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.704541    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-78qbx\""
Jul 08 21:09:58.709675 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.709655    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 21:09:58.715819 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.715796    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6498c7b5bb-6wbrc"]
Jul 08 21:09:58.730712 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfrsb\" (UniqueName: \"kubernetes.io/projected/2377154d-3bca-4f12-a1c5-daf75e539f27-kube-api-access-xfrsb\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.730863 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2377154d-3bca-4f12-a1c5-daf75e539f27-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.730863 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.730863 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ccw9\" (UniqueName: \"kubernetes.io/projected/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-kube-api-access-5ccw9\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.731023 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftwt6\" (UniqueName: \"kubernetes.io/projected/41ccbe14-5f86-4d32-9542-70effc085712-kube-api-access-ftwt6\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.731023 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-default-certificate\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.731023 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.731023 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.730999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.731222 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.731093    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:09:58.731222 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.731135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-config\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.731222 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.731151    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:09:59.231132504 +0000 UTC m=+237.483054706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : configmap references non-existent config key: service-ca.crt
Jul 08 21:09:58.731222 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.731197    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:09:59.231185085 +0000 UTC m=+237.483107301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : secret "router-metrics-certs-default" not found
Jul 08 21:09:58.731428 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.731234    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-stats-auth\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.731428 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.731265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.733436 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.733417    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-default-certificate\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.733523 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.733491    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-stats-auth\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.740871 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.740847    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftwt6\" (UniqueName: \"kubernetes.io/projected/41ccbe14-5f86-4d32-9542-70effc085712-kube-api-access-ftwt6\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:58.831947 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.831852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-image-registry-private-configuration\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.831947 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.831893    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6582\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-kube-api-access-w6582\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.831947 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.831914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfrsb\" (UniqueName: \"kubernetes.io/projected/2377154d-3bca-4f12-a1c5-daf75e539f27-kube-api-access-xfrsb\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.832229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.831994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.832229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832037    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-ca-trust-extracted\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.832229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-installation-pull-secrets\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.832229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ccw9\" (UniqueName: \"kubernetes.io/projected/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-kube-api-access-5ccw9\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.832229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-config\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832239    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-trusted-ca\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2377154d-3bca-4f12-a1c5-daf75e539f27-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832360    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-bound-sa-token\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.832409    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-certificates\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.832518 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.832466    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls podName:2377154d-3bca-4f12-a1c5-daf75e539f27 nodeName:}" failed. No retries permitted until 2026-07-08 21:09:59.332452959 +0000 UTC m=+237.584375140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lr9c9" (UID: "2377154d-3bca-4f12-a1c5-daf75e539f27") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:09:58.832862 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.832844    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-config\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.833020 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.833003    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2377154d-3bca-4f12-a1c5-daf75e539f27-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.834574 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.834559    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.842274 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.842249    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ccw9\" (UniqueName: \"kubernetes.io/projected/bc9590ce-7395-4562-87eb-3b2e49d5f2e5-kube-api-access-5ccw9\") pod \"service-ca-operator-5d46d9ffd4-gx4dg\" (UID: \"bc9590ce-7395-4562-87eb-3b2e49d5f2e5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.842743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.842725    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfrsb\" (UniqueName: \"kubernetes.io/projected/2377154d-3bca-4f12-a1c5-daf75e539f27-kube-api-access-xfrsb\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:58.925443 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.925405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"
Jul 08 21:09:58.933582 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.933559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6582\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-kube-api-access-w6582\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.933650 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.933596    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.933650 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.933612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-ca-trust-extracted\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.933759 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.933737    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:09:58.933809 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.933764    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498c7b5bb-6wbrc: secret "image-registry-tls" not found
Jul 08 21:09:58.933809 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.933767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-installation-pull-secrets\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.933907 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:58.933827    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls podName:bf9c8311-21d8-4c07-a657-5ed7ae1b1e51 nodeName:}" failed. No retries permitted until 2026-07-08 21:09:59.433803628 +0000 UTC m=+237.685725822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls") pod "image-registry-6498c7b5bb-6wbrc" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51") : secret "image-registry-tls" not found
Jul 08 21:09:58.933975 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.933910    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-ca-trust-extracted\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.933975 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.933924    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-trusted-ca\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.934073 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.934004    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-bound-sa-token\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.934073 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.934034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-certificates\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.934177 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.934096    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-image-registry-private-configuration\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.934655 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.934627    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-certificates\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.934760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.934709    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-trusted-ca\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.936306 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.936279    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-image-registry-private-configuration\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.936428 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.936404    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-installation-pull-secrets\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.941623 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.941603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-bound-sa-token\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:58.941744 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:58.941727    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6582\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-kube-api-access-w6582\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:59.044982 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:59.044949    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg"]
Jul 08 21:09:59.047887 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:09:59.047859    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9590ce_7395_4562_87eb_3b2e49d5f2e5.slice/crio-f8c07875aa8f0d0f8842fb76a807c13045bdd347fb71a1b300da78d5807c0080 WatchSource:0}: Error finding container f8c07875aa8f0d0f8842fb76a807c13045bdd347fb71a1b300da78d5807c0080: Status 404 returned error can't find the container with id f8c07875aa8f0d0f8842fb76a807c13045bdd347fb71a1b300da78d5807c0080
Jul 08 21:09:59.237130 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:59.237088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:59.237321 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:59.237161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:09:59.237321 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.237272    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:00.237254916 +0000 UTC m=+238.489177104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : configmap references non-existent config key: service-ca.crt
Jul 08 21:09:59.237477 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.237319    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:09:59.237477 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.237408    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:00.237388835 +0000 UTC m=+238.489311033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : secret "router-metrics-certs-default" not found
Jul 08 21:09:59.337756 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:59.337719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:09:59.337866 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.337839    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:09:59.337901 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.337890    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls podName:2377154d-3bca-4f12-a1c5-daf75e539f27 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:00.337876929 +0000 UTC m=+238.589799110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lr9c9" (UID: "2377154d-3bca-4f12-a1c5-daf75e539f27") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:09:59.438650 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:59.438614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:09:59.438802 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.438723    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:09:59.438802 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.438735    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498c7b5bb-6wbrc: secret "image-registry-tls" not found
Jul 08 21:09:59.438802 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:09:59.438783    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls podName:bf9c8311-21d8-4c07-a657-5ed7ae1b1e51 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:00.438770641 +0000 UTC m=+238.690692821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls") pod "image-registry-6498c7b5bb-6wbrc" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51") : secret "image-registry-tls" not found
Jul 08 21:09:59.896945 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:09:59.896904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg" event={"ID":"bc9590ce-7395-4562-87eb-3b2e49d5f2e5","Type":"ContainerStarted","Data":"f8c07875aa8f0d0f8842fb76a807c13045bdd347fb71a1b300da78d5807c0080"}
Jul 08 21:10:00.244352 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:00.244256    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:00.244533 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:00.244404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:00.244533 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.244443    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:10:00.244647 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.244633    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:02.244503007 +0000 UTC m=+240.496425190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : secret "router-metrics-certs-default" not found
Jul 08 21:10:00.244706 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.244662    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:02.244653038 +0000 UTC m=+240.496575225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : configmap references non-existent config key: service-ca.crt
Jul 08 21:10:00.345687 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:00.345642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:00.345877 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.345787    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:00.345877 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.345849    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls podName:2377154d-3bca-4f12-a1c5-daf75e539f27 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:02.345834411 +0000 UTC m=+240.597756591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lr9c9" (UID: "2377154d-3bca-4f12-a1c5-daf75e539f27") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:00.447185 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:00.447099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:00.447466 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.447243    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:10:00.447466 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.447262    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498c7b5bb-6wbrc: secret "image-registry-tls" not found
Jul 08 21:10:00.447466 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:00.447331    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls podName:bf9c8311-21d8-4c07-a657-5ed7ae1b1e51 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:02.447312348 +0000 UTC m=+240.699234532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls") pod "image-registry-6498c7b5bb-6wbrc" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51") : secret "image-registry-tls" not found
Jul 08 21:10:02.263248 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:02.263213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:02.263619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:02.263295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:02.263619 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.263399    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:06.263380628 +0000 UTC m=+244.515302823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : configmap references non-existent config key: service-ca.crt
Jul 08 21:10:02.263619 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.263464    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:10:02.263619 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.263537    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:06.263520206 +0000 UTC m=+244.515442388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : secret "router-metrics-certs-default" not found
Jul 08 21:10:02.364196 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:02.364150    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:02.364388 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.364300    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:02.364439 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.364389    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls podName:2377154d-3bca-4f12-a1c5-daf75e539f27 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:06.364356549 +0000 UTC m=+244.616278729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lr9c9" (UID: "2377154d-3bca-4f12-a1c5-daf75e539f27") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:02.465167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:02.465069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:02.465315 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.465237    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:10:02.465315 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.465255    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498c7b5bb-6wbrc: secret "image-registry-tls" not found
Jul 08 21:10:02.465315 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:02.465311    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls podName:bf9c8311-21d8-4c07-a657-5ed7ae1b1e51 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:06.46529706 +0000 UTC m=+244.717219249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls") pod "image-registry-6498c7b5bb-6wbrc" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51") : secret "image-registry-tls" not found
Jul 08 21:10:02.906297 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:02.906264    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg" event={"ID":"bc9590ce-7395-4562-87eb-3b2e49d5f2e5","Type":"ContainerStarted","Data":"3f12a1ee44ef54397a053aba11c287783d7cf5ee779f59a9bd13746e95d1806a"}
Jul 08 21:10:02.920977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:02.920930    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg" podStartSLOduration=1.789330435 podStartE2EDuration="4.920917506s" totalImagesPullingTime="3.131587071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:02.920059039 +0000 UTC m=+241.171981241" watchObservedRunningTime="2026-07-08 21:10:02.920917506 +0000 UTC m=+241.172839707"
Jul 08 21:10:04.055865 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.055832    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8qtkf"]
Jul 08 21:10:04.059082 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.059062    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.061686 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.061661    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zz8jg\""
Jul 08 21:10:04.061819 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.061701    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 21:10:04.061819 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.061741    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 21:10:04.062614 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.062594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 21:10:04.062684 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.062597    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 21:10:04.173623 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.173582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8qtkf"]
Jul 08 21:10:04.179170 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.179146    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwpkp\" (UniqueName: \"kubernetes.io/projected/ca636af6-c2a3-4206-afd3-36538340c976-kube-api-access-kwpkp\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.179307 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.179285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.179384 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.179327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca636af6-c2a3-4206-afd3-36538340c976-data-volume\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.179447 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.179381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca636af6-c2a3-4206-afd3-36538340c976-crio-socket\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.179447 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.179420    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.279833 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.279792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.279833 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.279838    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca636af6-c2a3-4206-afd3-36538340c976-data-volume\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.280078 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.279886    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca636af6-c2a3-4206-afd3-36538340c976-crio-socket\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.280078 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.279909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.280078 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.279921    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.280078 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.279929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpkp\" (UniqueName: \"kubernetes.io/projected/ca636af6-c2a3-4206-afd3-36538340c976-kube-api-access-kwpkp\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.280078 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.279997    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:04.779976741 +0000 UTC m=+243.031898922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.280078 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.280025    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ca636af6-c2a3-4206-afd3-36538340c976-crio-socket\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.280301 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.280103    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:04.280301 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.280174    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:04.780160059 +0000 UTC m=+243.032082240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:04.280301 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.280246    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca636af6-c2a3-4206-afd3-36538340c976-data-volume\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.287634 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.287606    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpkp\" (UniqueName: \"kubernetes.io/projected/ca636af6-c2a3-4206-afd3-36538340c976-kube-api-access-kwpkp\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.784629 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.784582    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.784840 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:04.784659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:04.784840 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.784720    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.784840 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.784815    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:05.784798216 +0000 UTC m=+244.036720395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:04.784840 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.784829    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:04.785019 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:04.784892    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:05.784874467 +0000 UTC m=+244.036796648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:05.791569 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:05.791529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:05.792028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:05.791588    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:05.792028 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:05.791661    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:05.792028 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:05.791671    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:05.792028 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:05.791742    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:07.791718775 +0000 UTC m=+246.043640959 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:05.792028 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:05.791777    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:07.791767221 +0000 UTC m=+246.043689403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:06.296641 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.296610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:06.296801 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.296695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:06.296801 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.296762    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 21:10:06.296871 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.296825    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:14.296809921 +0000 UTC m=+252.548732101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : secret "router-metrics-certs-default" not found
Jul 08 21:10:06.296871 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.296839    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:14.296832599 +0000 UTC m=+252.548754778 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : configmap references non-existent config key: service-ca.crt
Jul 08 21:10:06.397356 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.397313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:06.397525 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.397483    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:06.397564 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.397548    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls podName:2377154d-3bca-4f12-a1c5-daf75e539f27 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:14.397534422 +0000 UTC m=+252.649456602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lr9c9" (UID: "2377154d-3bca-4f12-a1c5-daf75e539f27") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:06.497789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.497747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:06.497981 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.497878    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 21:10:06.497981 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.497901    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6498c7b5bb-6wbrc: secret "image-registry-tls" not found
Jul 08 21:10:06.497981 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:06.497958    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls podName:bf9c8311-21d8-4c07-a657-5ed7ae1b1e51 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:14.497942134 +0000 UTC m=+252.749864314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls") pod "image-registry-6498c7b5bb-6wbrc" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51") : secret "image-registry-tls" not found
Jul 08 21:10:06.507582 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.507551    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tx6pl"]
Jul 08 21:10:06.510711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.510696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.513214 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.513195    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 21:10:06.513214 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.513208    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 21:10:06.513389 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.513227    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 21:10:06.513389 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.513212    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 21:10:06.514430 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.514415    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rtddr\""
Jul 08 21:10:06.517280 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.517256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tx6pl"]
Jul 08 21:10:06.669132 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.669103    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6f5p2_f6615206-7688-4b36-a589-82299a33b18c/dns-node-resolver/0.log"
Jul 08 21:10:06.699333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.699295    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jngff\" (UniqueName: \"kubernetes.io/projected/9adb3e12-8d46-4dac-8326-1ab13580a989-kube-api-access-jngff\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.699516 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.699340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9adb3e12-8d46-4dac-8326-1ab13580a989-signing-key\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.699516 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.699433    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9adb3e12-8d46-4dac-8326-1ab13580a989-signing-cabundle\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.800221 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.800188    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9adb3e12-8d46-4dac-8326-1ab13580a989-signing-cabundle\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.800593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.800287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jngff\" (UniqueName: \"kubernetes.io/projected/9adb3e12-8d46-4dac-8326-1ab13580a989-kube-api-access-jngff\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.800593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.800315    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9adb3e12-8d46-4dac-8326-1ab13580a989-signing-key\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.800860 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.800838    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9adb3e12-8d46-4dac-8326-1ab13580a989-signing-cabundle\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.802613 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.802592    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9adb3e12-8d46-4dac-8326-1ab13580a989-signing-key\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.807684 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.807660    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jngff\" (UniqueName: \"kubernetes.io/projected/9adb3e12-8d46-4dac-8326-1ab13580a989-kube-api-access-jngff\") pod \"service-ca-758f599c5-tx6pl\" (UID: \"9adb3e12-8d46-4dac-8326-1ab13580a989\") " pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.820585 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.820566    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-tx6pl"
Jul 08 21:10:06.938976 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:06.938867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tx6pl"]
Jul 08 21:10:06.941295 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:06.941266    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adb3e12_8d46_4dac_8326_1ab13580a989.slice/crio-5b61737b2edf13bdf3d1af7070b4732da660528cbcd628fa88bcb58b745a86db WatchSource:0}: Error finding container 5b61737b2edf13bdf3d1af7070b4732da660528cbcd628fa88bcb58b745a86db: Status 404 returned error can't find the container with id 5b61737b2edf13bdf3d1af7070b4732da660528cbcd628fa88bcb58b745a86db
Jul 08 21:10:07.807494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:07.807457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:07.807858 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:07.807524    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:07.807858 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:07.807585    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:07.807858 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:07.807654    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:11.807637966 +0000 UTC m=+250.059560150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:07.807858 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:07.807698    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:07.807858 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:07.807762    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:11.807746143 +0000 UTC m=+250.059668327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:07.923626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:07.923590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-tx6pl" event={"ID":"9adb3e12-8d46-4dac-8326-1ab13580a989","Type":"ContainerStarted","Data":"870854aee680454bbb6f4841cb0adece78ac3315c29c0a724324cb30a019ed20"}
Jul 08 21:10:07.923772 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:07.923643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-tx6pl" event={"ID":"9adb3e12-8d46-4dac-8326-1ab13580a989","Type":"ContainerStarted","Data":"5b61737b2edf13bdf3d1af7070b4732da660528cbcd628fa88bcb58b745a86db"}
Jul 08 21:10:07.938839 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:07.938791    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-tx6pl" podStartSLOduration=1.9387762149999999 podStartE2EDuration="1.938776215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:07.938093821 +0000 UTC m=+246.190016023" watchObservedRunningTime="2026-07-08 21:10:07.938776215 +0000 UTC m=+246.190698416"
Jul 08 21:10:08.068576 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:08.068485    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sd2bb_a236567e-f033-45c4-b129-0c0018534103/node-ca/0.log"
Jul 08 21:10:08.671120 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:08.671080    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gvwfb_73cb0101-875e-4108-b4dd-d9618bcfd9ce/serve-healthcheck-canary/0.log"
Jul 08 21:10:11.840197 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:11.840156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:11.840617 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:11.840211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:11.840617 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:11.840290    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 21:10:11.840617 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:11.840311    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:11.840617 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:11.840387    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:19.84035237 +0000 UTC m=+258.092274551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : configmap "kube-rbac-proxy" not found
Jul 08 21:10:11.840617 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:11.840403    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls podName:ca636af6-c2a3-4206-afd3-36538340c976 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:19.840396195 +0000 UTC m=+258.092318375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8qtkf" (UID: "ca636af6-c2a3-4206-afd3-36538340c976") : secret "insights-runtime-extractor-tls" not found
Jul 08 21:10:14.062308 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.062271    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:10:14.062759 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:14.062462    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 21:10:14.062759 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:14.062533    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs podName:a19b781d-37ae-40b6-b470-992503443eba nodeName:}" failed. No retries permitted until 2026-07-08 21:12:16.062517237 +0000 UTC m=+374.314439417 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs") pod "network-metrics-daemon-rnk9k" (UID: "a19b781d-37ae-40b6-b470-992503443eba") : secret "metrics-daemon-secret" not found
Jul 08 21:10:14.364337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.364296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:14.364545 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.364418    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:14.364545 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:14.364481    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle podName:41ccbe14-5f86-4d32-9542-70effc085712 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:30.364463958 +0000 UTC m=+268.616386138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle") pod "router-default-5989d4555-zt8h6" (UID: "41ccbe14-5f86-4d32-9542-70effc085712") : configmap references non-existent config key: service-ca.crt
Jul 08 21:10:14.366811 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.366789    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/41ccbe14-5f86-4d32-9542-70effc085712-metrics-certs\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:14.465259 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.465217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:14.465435 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:14.465377    2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:14.465479 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:14.465441    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls podName:2377154d-3bca-4f12-a1c5-daf75e539f27 nodeName:}" failed. No retries permitted until 2026-07-08 21:10:30.465425438 +0000 UTC m=+268.717347630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lr9c9" (UID: "2377154d-3bca-4f12-a1c5-daf75e539f27") : secret "cluster-monitoring-operator-tls" not found
Jul 08 21:10:14.566313 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.566272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:14.568721 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.568691    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"image-registry-6498c7b5bb-6wbrc\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") " pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:14.613824 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.613795    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-78qbx\""
Jul 08 21:10:14.621689 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.621641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:14.747579 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.747554    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6498c7b5bb-6wbrc"]
Jul 08 21:10:14.749520 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:14.749494    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9c8311_21d8_4c07_a657_5ed7ae1b1e51.slice/crio-2bee2eddeaf850c672a1d2b649bff1587109d8454681f1fe4be0f6b1947e39ff WatchSource:0}: Error finding container 2bee2eddeaf850c672a1d2b649bff1587109d8454681f1fe4be0f6b1947e39ff: Status 404 returned error can't find the container with id 2bee2eddeaf850c672a1d2b649bff1587109d8454681f1fe4be0f6b1947e39ff
Jul 08 21:10:14.951601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.946924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" event={"ID":"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51","Type":"ContainerStarted","Data":"dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348"}
Jul 08 21:10:14.951601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.947034    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" event={"ID":"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51","Type":"ContainerStarted","Data":"2bee2eddeaf850c672a1d2b649bff1587109d8454681f1fe4be0f6b1947e39ff"}
Jul 08 21:10:14.951601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.947921    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:14.967188 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:14.967130    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" podStartSLOduration=16.967110415 podStartE2EDuration="16.967110415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:14.965554502 +0000 UTC m=+253.217476705" watchObservedRunningTime="2026-07-08 21:10:14.967110415 +0000 UTC m=+253.219032597"
Jul 08 21:10:19.908912 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:19.908870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:19.909335 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:19.908930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:19.909495 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:19.909475    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ca636af6-c2a3-4206-afd3-36538340c976-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:19.911189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:19.911165    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ca636af6-c2a3-4206-afd3-36538340c976-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8qtkf\" (UID: \"ca636af6-c2a3-4206-afd3-36538340c976\") " pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:19.969252 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:19.969221    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8qtkf"
Jul 08 21:10:20.095606 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:20.095519    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8qtkf"]
Jul 08 21:10:20.098076 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:20.098049    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca636af6_c2a3_4206_afd3_36538340c976.slice/crio-6ea5af0b9cd93faa4e003c4b7e958b3ec41f390719579b87b88349e120bbd06e WatchSource:0}: Error finding container 6ea5af0b9cd93faa4e003c4b7e958b3ec41f390719579b87b88349e120bbd06e: Status 404 returned error can't find the container with id 6ea5af0b9cd93faa4e003c4b7e958b3ec41f390719579b87b88349e120bbd06e
Jul 08 21:10:20.967658 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:20.967561    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qtkf" event={"ID":"ca636af6-c2a3-4206-afd3-36538340c976","Type":"ContainerStarted","Data":"6ea5af0b9cd93faa4e003c4b7e958b3ec41f390719579b87b88349e120bbd06e"}
Jul 08 21:10:23.979629 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:23.979589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qtkf" event={"ID":"ca636af6-c2a3-4206-afd3-36538340c976","Type":"ContainerStarted","Data":"320ac6c43a7742eb7ead85836450b4ec9ed6701ac7d143dc1d5104193e7b69fa"}
Jul 08 21:10:24.984480 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:24.984399    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qtkf" event={"ID":"ca636af6-c2a3-4206-afd3-36538340c976","Type":"ContainerStarted","Data":"c2160da6f22fa94d90358a1a590877ee46b22e161d7b7a9f85f12407983158f4"}
Jul 08 21:10:25.143682 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.143648    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6498c7b5bb-6wbrc"]
Jul 08 21:10:25.180210 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.180176    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b4c974bdb-cckw7"]
Jul 08 21:10:25.183140 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.183120    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.196050 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.196026    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4c974bdb-cckw7"]
Jul 08 21:10:25.255797 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.255724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/875075ab-ca56-4e50-9276-c8b9ec4c05f5-trusted-ca\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.255797 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.255766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/875075ab-ca56-4e50-9276-c8b9ec4c05f5-registry-certificates\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.255797 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.255797    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/875075ab-ca56-4e50-9276-c8b9ec4c05f5-ca-trust-extracted\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.256055 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.255888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-registry-tls\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.256055 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.255932    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv2fh\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-kube-api-access-gv2fh\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.256055 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.255995    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/875075ab-ca56-4e50-9276-c8b9ec4c05f5-image-registry-private-configuration\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.256217 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.256127    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-bound-sa-token\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.256217 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.256178    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/875075ab-ca56-4e50-9276-c8b9ec4c05f5-installation-pull-secrets\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357295 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/875075ab-ca56-4e50-9276-c8b9ec4c05f5-trusted-ca\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357295 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/875075ab-ca56-4e50-9276-c8b9ec4c05f5-registry-certificates\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357548 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/875075ab-ca56-4e50-9276-c8b9ec4c05f5-ca-trust-extracted\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357605 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357581    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-registry-tls\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357656 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv2fh\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-kube-api-access-gv2fh\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357708 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357695    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/875075ab-ca56-4e50-9276-c8b9ec4c05f5-image-registry-private-configuration\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357786    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-bound-sa-token\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.357984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.357826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/875075ab-ca56-4e50-9276-c8b9ec4c05f5-installation-pull-secrets\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.358321 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.358284    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/875075ab-ca56-4e50-9276-c8b9ec4c05f5-registry-certificates\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.358822 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.358645    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/875075ab-ca56-4e50-9276-c8b9ec4c05f5-trusted-ca\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.358822 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.358782    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/875075ab-ca56-4e50-9276-c8b9ec4c05f5-ca-trust-extracted\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.360483 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.360459    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/875075ab-ca56-4e50-9276-c8b9ec4c05f5-image-registry-private-configuration\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.360630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.360609    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-registry-tls\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.360711 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.360668    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/875075ab-ca56-4e50-9276-c8b9ec4c05f5-installation-pull-secrets\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.365599 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.365544    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-bound-sa-token\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.366046 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.366025    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv2fh\" (UniqueName: \"kubernetes.io/projected/875075ab-ca56-4e50-9276-c8b9ec4c05f5-kube-api-access-gv2fh\") pod \"image-registry-b4c974bdb-cckw7\" (UID: \"875075ab-ca56-4e50-9276-c8b9ec4c05f5\") " pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.492549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.492515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:25.638977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.638946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4c974bdb-cckw7"]
Jul 08 21:10:25.641965 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:25.641935    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875075ab_ca56_4e50_9276_c8b9ec4c05f5.slice/crio-ca7bfa85dae7c724ee3428ad4408fb17ffa2fcb90c5c5053e3df0aaf116d3693 WatchSource:0}: Error finding container ca7bfa85dae7c724ee3428ad4408fb17ffa2fcb90c5c5053e3df0aaf116d3693: Status 404 returned error can't find the container with id ca7bfa85dae7c724ee3428ad4408fb17ffa2fcb90c5c5053e3df0aaf116d3693
Jul 08 21:10:25.990537 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.990498    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" event={"ID":"875075ab-ca56-4e50-9276-c8b9ec4c05f5","Type":"ContainerStarted","Data":"fdea50671faab60b4de53cea4039502fe5062c4514cad56df557e3d27d548cb2"}
Jul 08 21:10:25.990944 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.990590    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" event={"ID":"875075ab-ca56-4e50-9276-c8b9ec4c05f5","Type":"ContainerStarted","Data":"ca7bfa85dae7c724ee3428ad4408fb17ffa2fcb90c5c5053e3df0aaf116d3693"}
Jul 08 21:10:25.990944 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:25.990636    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:10:26.009500 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:26.009438    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podStartSLOduration=1.009417331 podStartE2EDuration="1.009417331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:26.007758972 +0000 UTC m=+264.259681231" watchObservedRunningTime="2026-07-08 21:10:26.009417331 +0000 UTC m=+264.261339534"
Jul 08 21:10:27.999833 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:27.999800    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8qtkf" event={"ID":"ca636af6-c2a3-4206-afd3-36538340c976","Type":"ContainerStarted","Data":"167a696a5289fda1789031e4299084cd6ec7abe7b3740fbee6f8aaacbbf4fc60"}
Jul 08 21:10:28.017001 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:28.016951    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8qtkf" podStartSLOduration=16.950451809 podStartE2EDuration="24.016935305s" totalImagesPullingTime="7.066483496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:10:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:28.015423152 +0000 UTC m=+266.267345355" watchObservedRunningTime="2026-07-08 21:10:28.016935305 +0000 UTC m=+266.268857507"
Jul 08 21:10:30.396917 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.396883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:30.397492 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.397474    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41ccbe14-5f86-4d32-9542-70effc085712-service-ca-bundle\") pod \"router-default-5989d4555-zt8h6\" (UID: \"41ccbe14-5f86-4d32-9542-70effc085712\") " pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:30.497412 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.497345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:30.499672 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.499653    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2377154d-3bca-4f12-a1c5-daf75e539f27-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lr9c9\" (UID: \"2377154d-3bca-4f12-a1c5-daf75e539f27\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:30.623788 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.623757    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ftnmf\""
Jul 08 21:10:30.632721 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.632696    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:30.731856 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.731831    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w2rrd\""
Jul 08 21:10:30.740686 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.740662    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"
Jul 08 21:10:30.759127 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.759029    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5989d4555-zt8h6"]
Jul 08 21:10:30.869027 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:30.868996    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9"]
Jul 08 21:10:30.871722 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:30.871695    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2377154d_3bca_4f12_a1c5_daf75e539f27.slice/crio-b563e80ff3f8ef742cbe28eb106f8d300c157788b244908c8d73f1157070b23e WatchSource:0}: Error finding container b563e80ff3f8ef742cbe28eb106f8d300c157788b244908c8d73f1157070b23e: Status 404 returned error can't find the container with id b563e80ff3f8ef742cbe28eb106f8d300c157788b244908c8d73f1157070b23e
Jul 08 21:10:31.011858 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:31.011785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9" event={"ID":"2377154d-3bca-4f12-a1c5-daf75e539f27","Type":"ContainerStarted","Data":"b563e80ff3f8ef742cbe28eb106f8d300c157788b244908c8d73f1157070b23e"}
Jul 08 21:10:31.013133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:31.013113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5989d4555-zt8h6" event={"ID":"41ccbe14-5f86-4d32-9542-70effc085712","Type":"ContainerStarted","Data":"f4071beca8492b0b81deb6fd27c1cd50a980bef8854db5aa3fd9dbc5c5377328"}
Jul 08 21:10:31.013240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:31.013144    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5989d4555-zt8h6" event={"ID":"41ccbe14-5f86-4d32-9542-70effc085712","Type":"ContainerStarted","Data":"248ae8b0029a301fe1bf1e074b67c7b76a1365061a8aefcc37b2fff33ab5176d"}
Jul 08 21:10:31.030442 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:31.030402    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5989d4555-zt8h6" podStartSLOduration=33.030385502 podStartE2EDuration="33.030385502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:31.029126859 +0000 UTC m=+269.281049064" watchObservedRunningTime="2026-07-08 21:10:31.030385502 +0000 UTC m=+269.282307700"
Jul 08 21:10:31.633256 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:31.633220    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:31.635736 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:31.635711    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:32.016674 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:32.016595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:32.017850 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:32.017830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5989d4555-zt8h6"
Jul 08 21:10:34.024277 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:34.024240    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9" event={"ID":"2377154d-3bca-4f12-a1c5-daf75e539f27","Type":"ContainerStarted","Data":"87d92d3959d1a8d4d4ef175b3394638c03a54b80b858ff33ad2f03f555bdcb68"}
Jul 08 21:10:34.039667 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:34.039617    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lr9c9" podStartSLOduration=33.901686949 podStartE2EDuration="36.039602965s" totalImagesPullingTime="2.137916016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:09:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:34.038820542 +0000 UTC m=+272.290742744" watchObservedRunningTime="2026-07-08 21:10:34.039602965 +0000 UTC m=+272.291525191"
Jul 08 21:10:35.149490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:35.149456    2560 patch_prober.go:28] interesting pod/image-registry-6498c7b5bb-6wbrc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:10:35.150003 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:35.149513    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:10:40.863632 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.863593    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"]
Jul 08 21:10:40.866359 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.866342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:40.868793 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.868768    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mcw76\""
Jul 08 21:10:40.868909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.868818    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 21:10:40.868909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.868768    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 21:10:40.869821 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.869807    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 21:10:40.880386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.878633    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"]
Jul 08 21:10:40.886083 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.886052    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hfgmn"]
Jul 08 21:10:40.888091 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.888068    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.890628 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.890601    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 21:10:40.890768 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.890718    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 21:10:40.891894 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.891873    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 21:10:40.892200 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.892183    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vmxqb\""
Jul 08 21:10:40.983571 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983571 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-sys\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-root\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkkkr\" (UniqueName: \"kubernetes.io/projected/2ba28274-0d75-44ae-917c-0b3853be631e-kube-api-access-tkkkr\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983705    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-tls\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e29d9cdb-1f67-4419-97e7-44d951dbecbf-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:40.983977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-wtmp\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdlx5\" (UniqueName: \"kubernetes.io/projected/e29d9cdb-1f67-4419-97e7-44d951dbecbf-kube-api-access-vdlx5\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:40.983977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ba28274-0d75-44ae-917c-0b3853be631e-metrics-client-ca\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983896    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-textfile\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.983977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983916    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:40.984143 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.983986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e29d9cdb-1f67-4419-97e7-44d951dbecbf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:40.984143 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:40.984019    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e29d9cdb-1f67-4419-97e7-44d951dbecbf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.084971 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.084929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.084984    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-sys\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-root\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085035    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkkkr\" (UniqueName: \"kubernetes.io/projected/2ba28274-0d75-44ae-917c-0b3853be631e-kube-api-access-tkkkr\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085070    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-tls\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085127    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-sys\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085135    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-root\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e29d9cdb-1f67-4419-97e7-44d951dbecbf-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.085349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085273    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-wtmp\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdlx5\" (UniqueName: \"kubernetes.io/projected/e29d9cdb-1f67-4419-97e7-44d951dbecbf-kube-api-access-vdlx5\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.085561 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085354    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ba28274-0d75-44ae-917c-0b3853be631e-metrics-client-ca\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085561 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085407    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-textfile\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085561 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085433    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085561 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e29d9cdb-1f67-4419-97e7-44d951dbecbf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.085561 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085532    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e29d9cdb-1f67-4419-97e7-44d951dbecbf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.085827 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085588    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085827 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085720    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-wtmp\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.085944 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085895    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e29d9cdb-1f67-4419-97e7-44d951dbecbf-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.085996 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.085963    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ba28274-0d75-44ae-917c-0b3853be631e-metrics-client-ca\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.086180 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.086159    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-textfile\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.087762 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.087734    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.087900 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.087882    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2ba28274-0d75-44ae-917c-0b3853be631e-node-exporter-tls\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.087962 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.087898    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e29d9cdb-1f67-4419-97e7-44d951dbecbf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.088320 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.088303    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e29d9cdb-1f67-4419-97e7-44d951dbecbf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.092679 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.092662    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkkkr\" (UniqueName: \"kubernetes.io/projected/2ba28274-0d75-44ae-917c-0b3853be631e-kube-api-access-tkkkr\") pod \"node-exporter-hfgmn\" (UID: \"2ba28274-0d75-44ae-917c-0b3853be631e\") " pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.092945 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.092928    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdlx5\" (UniqueName: \"kubernetes.io/projected/e29d9cdb-1f67-4419-97e7-44d951dbecbf-kube-api-access-vdlx5\") pod \"openshift-state-metrics-54cf96dfcf-6vqwr\" (UID: \"e29d9cdb-1f67-4419-97e7-44d951dbecbf\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.176730 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.176646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"
Jul 08 21:10:41.200220 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.200185    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hfgmn"
Jul 08 21:10:41.210315 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:41.210284    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba28274_0d75_44ae_917c_0b3853be631e.slice/crio-06d0b1d19754b61596ba6d72036e7d5e698de8dd1a9aab8f3ad24ded1dbb8cba WatchSource:0}: Error finding container 06d0b1d19754b61596ba6d72036e7d5e698de8dd1a9aab8f3ad24ded1dbb8cba: Status 404 returned error can't find the container with id 06d0b1d19754b61596ba6d72036e7d5e698de8dd1a9aab8f3ad24ded1dbb8cba
Jul 08 21:10:41.310317 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:41.310286    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr"]
Jul 08 21:10:41.313117 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:41.313088    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29d9cdb_1f67_4419_97e7_44d951dbecbf.slice/crio-5dad4a1714c3bf4b589d076cd86e5a46683cb921e782193ba79c52e7f67d5558 WatchSource:0}: Error finding container 5dad4a1714c3bf4b589d076cd86e5a46683cb921e782193ba79c52e7f67d5558: Status 404 returned error can't find the container with id 5dad4a1714c3bf4b589d076cd86e5a46683cb921e782193ba79c52e7f67d5558
Jul 08 21:10:42.052626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:42.052587    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr" event={"ID":"e29d9cdb-1f67-4419-97e7-44d951dbecbf","Type":"ContainerStarted","Data":"801ec0eb3f8c9c4fada80c4f8b5edf133218a76c074356ed50d64216bc4b10b3"}
Jul 08 21:10:42.053117 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:42.052663    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr" event={"ID":"e29d9cdb-1f67-4419-97e7-44d951dbecbf","Type":"ContainerStarted","Data":"b97f1d0d700e74d4b1f8675976061c9dec935fe0718483557b023b76f76a6727"}
Jul 08 21:10:42.053117 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:42.052692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr" event={"ID":"e29d9cdb-1f67-4419-97e7-44d951dbecbf","Type":"ContainerStarted","Data":"5dad4a1714c3bf4b589d076cd86e5a46683cb921e782193ba79c52e7f67d5558"}
Jul 08 21:10:42.054073 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:42.054040    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfgmn" event={"ID":"2ba28274-0d75-44ae-917c-0b3853be631e","Type":"ContainerStarted","Data":"06d0b1d19754b61596ba6d72036e7d5e698de8dd1a9aab8f3ad24ded1dbb8cba"}
Jul 08 21:10:43.062547 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:43.062512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr" event={"ID":"e29d9cdb-1f67-4419-97e7-44d951dbecbf","Type":"ContainerStarted","Data":"035d25313980b88192531a6e14e157c392947b248e0db037baad9353c9176aff"}
Jul 08 21:10:43.064060 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:43.064030    2560 generic.go:356] "Generic (PLEG): container finished" podID="2ba28274-0d75-44ae-917c-0b3853be631e" containerID="37a90e1352ef54a249d43450df7497c0467b50b6a6bc50d50266127450da6386" exitCode=0
Jul 08 21:10:43.064184 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:43.064084    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfgmn" event={"ID":"2ba28274-0d75-44ae-917c-0b3853be631e","Type":"ContainerDied","Data":"37a90e1352ef54a249d43450df7497c0467b50b6a6bc50d50266127450da6386"}
Jul 08 21:10:43.079621 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:43.079577    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-6vqwr" podStartSLOduration=1.9309991549999999 podStartE2EDuration="3.079562473s" totalImagesPullingTime="1.148563318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:43.077799467 +0000 UTC m=+281.329721670" watchObservedRunningTime="2026-07-08 21:10:43.079562473 +0000 UTC m=+281.331484675"
Jul 08 21:10:43.705788 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:43.705733    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7t2x7" podUID="4cfb69ae-b74c-400c-a273-35b9927a0142"
Jul 08 21:10:44.069448 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:44.069342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfgmn" event={"ID":"2ba28274-0d75-44ae-917c-0b3853be631e","Type":"ContainerStarted","Data":"3f077ed7b9fb831a9516d70dd2ccb6e56d2472e2310542c3d8043cf28b15221d"}
Jul 08 21:10:44.069448 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:44.069393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:10:44.069448 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:44.069423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfgmn" event={"ID":"2ba28274-0d75-44ae-917c-0b3853be631e","Type":"ContainerStarted","Data":"578cef319ab079677f5a0555d6f49cbbc328dfcdae94b1a4cbfb441130314899"}
Jul 08 21:10:44.087418 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:44.087325    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hfgmn" podStartSLOduration=2.95528761 podStartE2EDuration="4.087309763s" totalImagesPullingTime="1.060577664s" totalInitContainerRuntime="71.444489ms" isStatefulPod=true podCreationTimestamp="2026-07-08 21:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:44.085685787 +0000 UTC m=+282.337608002" watchObservedRunningTime="2026-07-08 21:10:44.087309763 +0000 UTC m=+282.339231964"
Jul 08 21:10:45.148070 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.148035    2560 patch_prober.go:28] interesting pod/image-registry-6498c7b5bb-6wbrc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:10:45.148455 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.148096    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:10:45.497150 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.497064    2560 patch_prober.go:28] interesting pod/image-registry-b4c974bdb-cckw7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:10:45.497150 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.497124    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:10:45.720887 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.720858    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d74dd88f-lfs2h"]
Jul 08 21:10:45.722768 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.722749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.725267 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.725239    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 21:10:45.726483 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726460    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 21:10:45.726629 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726537    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 21:10:45.726801 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726781    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r54dz\""
Jul 08 21:10:45.726909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726867    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 21:10:45.726909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726869    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 21:10:45.727025 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726911    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 21:10:45.727025 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.726972    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 21:10:45.731043 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.731026    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 21:10:45.733779 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.733761    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d74dd88f-lfs2h"]
Jul 08 21:10:45.827875 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.827775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-config\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.827875 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.827820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-trusted-ca-bundle\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.828075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.827933    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-service-ca\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.828075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.827979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-oauth-serving-cert\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.828075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.828005    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd27k\" (UniqueName: \"kubernetes.io/projected/53611abd-8e40-4a70-8af7-ecd07db6e80e-kube-api-access-vd27k\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.828075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.828031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-serving-cert\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.828075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.828055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-oauth-config\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929341 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-service-ca\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-oauth-serving-cert\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd27k\" (UniqueName: \"kubernetes.io/projected/53611abd-8e40-4a70-8af7-ecd07db6e80e-kube-api-access-vd27k\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929454    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-serving-cert\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-oauth-config\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929540    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-config\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.929845 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.929568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-trusted-ca-bundle\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.930209 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.930181    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-service-ca\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.930312 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.930206    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-config\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.930408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.930384    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-oauth-serving-cert\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.930458 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.930420    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-trusted-ca-bundle\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.932007 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.931986    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-oauth-config\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.932110 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.932094    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-serving-cert\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:45.937341 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:45.937315    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd27k\" (UniqueName: \"kubernetes.io/projected/53611abd-8e40-4a70-8af7-ecd07db6e80e-kube-api-access-vd27k\") pod \"console-5d74dd88f-lfs2h\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") " pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:46.032506 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:46.032472    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:46.155592 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:46.155467    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d74dd88f-lfs2h"]
Jul 08 21:10:46.157953 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:46.157927    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53611abd_8e40_4a70_8af7_ecd07db6e80e.slice/crio-0ac5dc68b14945b66ce3cf77dccaebb95e37a7f9ff4d0473814b90c9c3172893 WatchSource:0}: Error finding container 0ac5dc68b14945b66ce3cf77dccaebb95e37a7f9ff4d0473814b90c9c3172893: Status 404 returned error can't find the container with id 0ac5dc68b14945b66ce3cf77dccaebb95e37a7f9ff4d0473814b90c9c3172893
Jul 08 21:10:46.999996 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:46.999963    2560 patch_prober.go:28] interesting pod/image-registry-b4c974bdb-cckw7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:10:47.000169 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.000023    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:10:47.082526 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.082486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d74dd88f-lfs2h" event={"ID":"53611abd-8e40-4a70-8af7-ecd07db6e80e","Type":"ContainerStarted","Data":"0ac5dc68b14945b66ce3cf77dccaebb95e37a7f9ff4d0473814b90c9c3172893"}
Jul 08 21:10:47.141318 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.141281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:10:47.143606 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.143574    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cfb69ae-b74c-400c-a273-35b9927a0142-metrics-tls\") pod \"dns-default-7t2x7\" (UID: \"4cfb69ae-b74c-400c-a273-35b9927a0142\") " pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:10:47.373033 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.373006    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ltsxq\""
Jul 08 21:10:47.381836 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.381816    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:10:47.519189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:47.519163    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7t2x7"]
Jul 08 21:10:47.522420 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:10:47.522383    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfb69ae_b74c_400c_a273_35b9927a0142.slice/crio-ba6858dc5cab970d5109ae401a135926a84160a67043ca1fe1b7dcd890aae8d6 WatchSource:0}: Error finding container ba6858dc5cab970d5109ae401a135926a84160a67043ca1fe1b7dcd890aae8d6: Status 404 returned error can't find the container with id ba6858dc5cab970d5109ae401a135926a84160a67043ca1fe1b7dcd890aae8d6
Jul 08 21:10:48.087768 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:48.087727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2x7" event={"ID":"4cfb69ae-b74c-400c-a273-35b9927a0142","Type":"ContainerStarted","Data":"ba6858dc5cab970d5109ae401a135926a84160a67043ca1fe1b7dcd890aae8d6"}
Jul 08 21:10:50.096195 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.096156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d74dd88f-lfs2h" event={"ID":"53611abd-8e40-4a70-8af7-ecd07db6e80e","Type":"ContainerStarted","Data":"7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419"}
Jul 08 21:10:50.097896 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.097872    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2x7" event={"ID":"4cfb69ae-b74c-400c-a273-35b9927a0142","Type":"ContainerStarted","Data":"3abb3988a4852123674abe782c97eb51562e290c9b6a000ce1bbe3be46609571"}
Jul 08 21:10:50.097986 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.097913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7t2x7" event={"ID":"4cfb69ae-b74c-400c-a273-35b9927a0142","Type":"ContainerStarted","Data":"f5931e819a02a09ea3ca6eabccd3d56cd442f5530cab7a993311b29933065f5e"}
Jul 08 21:10:50.097986 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.097934    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:10:50.113395 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.113335    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d74dd88f-lfs2h" podStartSLOduration=1.586066515 podStartE2EDuration="5.113321126s" totalImagesPullingTime="3.527254611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:50.11179392 +0000 UTC m=+288.363716123" watchObservedRunningTime="2026-07-08 21:10:50.113321126 +0000 UTC m=+288.365243328"
Jul 08 21:10:50.128054 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.128002    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7t2x7" podStartSLOduration=250.96605976 podStartE2EDuration="4m13.127987843s" totalImagesPullingTime="2.161928083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:10:50.127243348 +0000 UTC m=+288.379165549" watchObservedRunningTime="2026-07-08 21:10:50.127987843 +0000 UTC m=+288.379910044"
Jul 08 21:10:50.164434 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.164395    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerName="registry" containerID="cri-o://dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348" gracePeriod=30
Jul 08 21:10:50.404211 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.404186    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:50.573109 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573077    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-ca-trust-extracted\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573109 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573116    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-certificates\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-installation-pull-secrets\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-bound-sa-token\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573239    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6582\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-kube-api-access-w6582\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573278    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-image-registry-private-configuration\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-trusted-ca\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573339    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") pod \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\" (UID: \"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51\") "
Jul 08 21:10:50.573687 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.573577    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:10:50.574106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.574079    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:10:50.575649 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.575619    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:10:50.575779 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.575762    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:10:50.575855 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.575833    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:10:50.575894 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.575853    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-kube-api-access-w6582" (OuterVolumeSpecName: "kube-api-access-w6582") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "kube-api-access-w6582". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:10:50.575958 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.575936    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:10:50.581011 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.580991    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" (UID: "bf9c8311-21d8-4c07-a657-5ed7ae1b1e51"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674048    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-certificates\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674096    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-installation-pull-secrets\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674107    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-bound-sa-token\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674116    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6582\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-kube-api-access-w6582\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674125    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-image-registry-private-configuration\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674136    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-trusted-ca\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674144    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-registry-tls\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:50.674149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:50.674151    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51-ca-trust-extracted\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:10:51.102074 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.102040    2560 generic.go:356] "Generic (PLEG): container finished" podID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerID="dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348" exitCode=0
Jul 08 21:10:51.102522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.102083    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc"
Jul 08 21:10:51.102522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.102124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" event={"ID":"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51","Type":"ContainerDied","Data":"dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348"}
Jul 08 21:10:51.102522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.102175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6498c7b5bb-6wbrc" event={"ID":"bf9c8311-21d8-4c07-a657-5ed7ae1b1e51","Type":"ContainerDied","Data":"2bee2eddeaf850c672a1d2b649bff1587109d8454681f1fe4be0f6b1947e39ff"}
Jul 08 21:10:51.102522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.102195    2560 scope.go:117] "RemoveContainer" containerID="dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348"
Jul 08 21:10:51.110540 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.110526    2560 scope.go:117] "RemoveContainer" containerID="dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348"
Jul 08 21:10:51.110806 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:51.110787    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348\": container with ID starting with dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348 not found: ID does not exist" containerID="dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348"
Jul 08 21:10:51.110871 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.110813    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348"} err="failed to get container status \"dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348\": rpc error: code = NotFound desc = could not find container \"dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348\": container with ID starting with dbbd21cd606ad4dc912093eb65e1b7d0bbe0f571e199a56bcb61a132b4984348 not found: ID does not exist"
Jul 08 21:10:51.122126 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.122102    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6498c7b5bb-6wbrc"]
Jul 08 21:10:51.127767 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:51.127749    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6498c7b5bb-6wbrc"]
Jul 08 21:10:52.203464 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:52.203432    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" path="/var/lib/kubelet/pods/bf9c8311-21d8-4c07-a657-5ed7ae1b1e51/volumes"
Jul 08 21:10:55.496698 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:55.496665    2560 patch_prober.go:28] interesting pod/image-registry-b4c974bdb-cckw7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:10:55.497086 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:55.496717    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:10:56.032930 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:56.032891    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:56.033179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:56.032957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:10:56.034314 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:56.034290    2560 patch_prober.go:28] interesting pod/console-5d74dd88f-lfs2h container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused" start-of-body=
Jul 08 21:10:56.034435 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:56.034333    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5d74dd88f-lfs2h" podUID="53611abd-8e40-4a70-8af7-ecd07db6e80e" containerName="console" probeResult="failure" output="Get \"https://10.132.0.17:8443/health\": dial tcp 10.132.0.17:8443: connect: connection refused"
Jul 08 21:10:56.998725 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:56.998691    2560 patch_prober.go:28] interesting pod/image-registry-b4c974bdb-cckw7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:10:56.999100 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:10:56.998749    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:10:57.200683 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:10:57.200637    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rnk9k" podUID="a19b781d-37ae-40b6-b470-992503443eba"
Jul 08 21:11:00.104383 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:00.104331    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7t2x7"
Jul 08 21:11:02.075156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:02.075133    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 21:11:05.497022 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:05.496987    2560 patch_prober.go:28] interesting pod/image-registry-b4c974bdb-cckw7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:11:05.499644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:05.497039    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:11:05.499644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:05.497084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:11:05.499644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:05.497593    2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"fdea50671faab60b4de53cea4039502fe5062c4514cad56df557e3d27d548cb2"} pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 08 21:11:05.501213 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:05.501190    2560 patch_prober.go:28] interesting pod/image-registry-b4c974bdb-cckw7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 21:11:05.501351 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:05.501238    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 21:11:06.036719 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:06.036685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:11:06.040553 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:06.040531    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:11:07.400820 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:07.400786    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d74dd88f-lfs2h"]
Jul 08 21:11:08.203430 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:08.203396    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:11:09.167230 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:09.167193    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc9590ce-7395-4562-87eb-3b2e49d5f2e5" containerID="3f12a1ee44ef54397a053aba11c287783d7cf5ee779f59a9bd13746e95d1806a" exitCode=0
Jul 08 21:11:09.167618 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:09.167265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg" event={"ID":"bc9590ce-7395-4562-87eb-3b2e49d5f2e5","Type":"ContainerDied","Data":"3f12a1ee44ef54397a053aba11c287783d7cf5ee779f59a9bd13746e95d1806a"}
Jul 08 21:11:09.167618 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:09.167612    2560 scope.go:117] "RemoveContainer" containerID="3f12a1ee44ef54397a053aba11c287783d7cf5ee779f59a9bd13746e95d1806a"
Jul 08 21:11:10.172156 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:10.172124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-gx4dg" event={"ID":"bc9590ce-7395-4562-87eb-3b2e49d5f2e5","Type":"ContainerStarted","Data":"334a61f7efbcac22fdf9ce383c7d39f83664157406985e4d5ff6388e654a8a2d"}
Jul 08 21:11:15.501765 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:15.501736    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:11:19.625388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:19.625338    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5989d4555-zt8h6_41ccbe14-5f86-4d32-9542-70effc085712/router/0.log"
Jul 08 21:11:19.640626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:19.640600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gvwfb_73cb0101-875e-4108-b4dd-d9618bcfd9ce/serve-healthcheck-canary/0.log"
Jul 08 21:11:30.517052 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:30.516991    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" podUID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerName="registry" containerID="cri-o://fdea50671faab60b4de53cea4039502fe5062c4514cad56df557e3d27d548cb2" gracePeriod=30
Jul 08 21:11:32.246259 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.246228    2560 generic.go:356] "Generic (PLEG): container finished" podID="875075ab-ca56-4e50-9276-c8b9ec4c05f5" containerID="fdea50671faab60b4de53cea4039502fe5062c4514cad56df557e3d27d548cb2" exitCode=0
Jul 08 21:11:32.246673 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.246281    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" event={"ID":"875075ab-ca56-4e50-9276-c8b9ec4c05f5","Type":"ContainerDied","Data":"fdea50671faab60b4de53cea4039502fe5062c4514cad56df557e3d27d548cb2"}
Jul 08 21:11:32.246673 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.246317    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7" event={"ID":"875075ab-ca56-4e50-9276-c8b9ec4c05f5","Type":"ContainerStarted","Data":"3794fab431a33d1348db916842eb5a70cdda63b64010c82aa0a96fdbcb49e6b4"}
Jul 08 21:11:32.246673 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.246346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:11:32.420513 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.420470    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d74dd88f-lfs2h" podUID="53611abd-8e40-4a70-8af7-ecd07db6e80e" containerName="console" containerID="cri-o://7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419" gracePeriod=15
Jul 08 21:11:32.667309 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.667284    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:11:32.718561 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718523    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd27k\" (UniqueName: \"kubernetes.io/projected/53611abd-8e40-4a70-8af7-ecd07db6e80e-kube-api-access-vd27k\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.718748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718585    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-config\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.718748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718615    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-serving-cert\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.718748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718641    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-service-ca\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.718748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-trusted-ca-bundle\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.718748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-oauth-serving-cert\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.718748 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.718745    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-oauth-config\") pod \"53611abd-8e40-4a70-8af7-ecd07db6e80e\" (UID: \"53611abd-8e40-4a70-8af7-ecd07db6e80e\") "
Jul 08 21:11:32.719084 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.719032    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-config" (OuterVolumeSpecName: "console-config") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:32.719163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.719098    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-service-ca" (OuterVolumeSpecName: "service-ca") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:32.719163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.719112    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:32.719163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.719122    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:11:32.720885 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.720860    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:11:32.720993 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.720908    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:11:32.720993 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.720920    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53611abd-8e40-4a70-8af7-ecd07db6e80e-kube-api-access-vd27k" (OuterVolumeSpecName: "kube-api-access-vd27k") pod "53611abd-8e40-4a70-8af7-ecd07db6e80e" (UID: "53611abd-8e40-4a70-8af7-ecd07db6e80e"). InnerVolumeSpecName "kube-api-access-vd27k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:11:32.819753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819669    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd27k\" (UniqueName: \"kubernetes.io/projected/53611abd-8e40-4a70-8af7-ecd07db6e80e-kube-api-access-vd27k\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:32.819753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819706    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-config\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:32.819753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819722    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-serving-cert\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:32.819753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819738    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-service-ca\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:32.819753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819751    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-trusted-ca-bundle\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:32.820012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819765    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53611abd-8e40-4a70-8af7-ecd07db6e80e-oauth-serving-cert\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:32.820012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:32.819780    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53611abd-8e40-4a70-8af7-ecd07db6e80e-console-oauth-config\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:11:33.255618 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.255586    2560 generic.go:356] "Generic (PLEG): container finished" podID="53611abd-8e40-4a70-8af7-ecd07db6e80e" containerID="7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419" exitCode=0
Jul 08 21:11:33.256145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.255658    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d74dd88f-lfs2h"
Jul 08 21:11:33.256145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.255664    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d74dd88f-lfs2h" event={"ID":"53611abd-8e40-4a70-8af7-ecd07db6e80e","Type":"ContainerDied","Data":"7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419"}
Jul 08 21:11:33.256145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.255758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d74dd88f-lfs2h" event={"ID":"53611abd-8e40-4a70-8af7-ecd07db6e80e","Type":"ContainerDied","Data":"0ac5dc68b14945b66ce3cf77dccaebb95e37a7f9ff4d0473814b90c9c3172893"}
Jul 08 21:11:33.256145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.255790    2560 scope.go:117] "RemoveContainer" containerID="7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419"
Jul 08 21:11:33.264270 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.264252    2560 scope.go:117] "RemoveContainer" containerID="7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419"
Jul 08 21:11:33.264544 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:11:33.264526    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419\": container with ID starting with 7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419 not found: ID does not exist" containerID="7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419"
Jul 08 21:11:33.264590 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.264552    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419"} err="failed to get container status \"7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419\": rpc error: code = NotFound desc = could not find container \"7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419\": container with ID starting with 7ca37454f8da175a7b4e3766b683a0180b8bbbc7b5568224061e0d7a86b61419 not found: ID does not exist"
Jul 08 21:11:33.274319 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.274300    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d74dd88f-lfs2h"]
Jul 08 21:11:33.277829 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:33.277808    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d74dd88f-lfs2h"]
Jul 08 21:11:34.204552 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:34.204508    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53611abd-8e40-4a70-8af7-ecd07db6e80e" path="/var/lib/kubelet/pods/53611abd-8e40-4a70-8af7-ecd07db6e80e/volumes"
Jul 08 21:11:53.260631 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:11:53.260595    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b4c974bdb-cckw7"
Jul 08 21:12:05.172681 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.172643    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-577c4f4744-nr969"]
Jul 08 21:12:05.173154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.172995    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerName="registry"
Jul 08 21:12:05.173154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.173009    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerName="registry"
Jul 08 21:12:05.173154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.173035    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53611abd-8e40-4a70-8af7-ecd07db6e80e" containerName="console"
Jul 08 21:12:05.173154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.173045    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="53611abd-8e40-4a70-8af7-ecd07db6e80e" containerName="console"
Jul 08 21:12:05.173154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.173125    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="53611abd-8e40-4a70-8af7-ecd07db6e80e" containerName="console"
Jul 08 21:12:05.173154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.173135    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9c8311-21d8-4c07-a657-5ed7ae1b1e51" containerName="registry"
Jul 08 21:12:05.177376 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.177344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.180842 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.180816    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 21:12:05.180989 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.180863    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-r54dz\""
Jul 08 21:12:05.180989 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.180888    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 21:12:05.180989 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.180916    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 21:12:05.181163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.181014    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 21:12:05.181163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.181056    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 21:12:05.181163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.181077    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 21:12:05.181163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.181095    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 21:12:05.185605 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.185584    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 21:12:05.187099 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.187068    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577c4f4744-nr969"]
Jul 08 21:12:05.283598 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-console-config\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.283760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283602    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-trusted-ca-bundle\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.283760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-service-ca\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.283760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmtw\" (UniqueName: \"kubernetes.io/projected/7231457c-b1ac-42a4-bc55-2b676305b837-kube-api-access-rhmtw\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.283760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283722    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-serving-cert\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.283760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283742    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-oauth-serving-cert\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.283926 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.283771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-oauth-config\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384466 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384435    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-trusted-ca-bundle\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-service-ca\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmtw\" (UniqueName: \"kubernetes.io/projected/7231457c-b1ac-42a4-bc55-2b676305b837-kube-api-access-rhmtw\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-serving-cert\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384555    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-oauth-serving-cert\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-oauth-config\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.384812 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.384643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-console-config\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.385294 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.385271    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-oauth-serving-cert\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.385469 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.385391    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-service-ca\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.385469 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.385437    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-console-config\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.385548 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.385482    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-trusted-ca-bundle\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.387220 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.387191    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-oauth-config\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.387311 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.387280    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-serving-cert\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.392401 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.392360    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmtw\" (UniqueName: \"kubernetes.io/projected/7231457c-b1ac-42a4-bc55-2b676305b837-kube-api-access-rhmtw\") pod \"console-577c4f4744-nr969\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") " pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.488590 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.488497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:05.615116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:05.615087    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-577c4f4744-nr969"]
Jul 08 21:12:05.617442 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:12:05.617415    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7231457c_b1ac_42a4_bc55_2b676305b837.slice/crio-7583dffcfb1b3cac36b2f66cd083a58f20aeb7fcc774bc3f74b63bccf0377a77 WatchSource:0}: Error finding container 7583dffcfb1b3cac36b2f66cd083a58f20aeb7fcc774bc3f74b63bccf0377a77: Status 404 returned error can't find the container with id 7583dffcfb1b3cac36b2f66cd083a58f20aeb7fcc774bc3f74b63bccf0377a77
Jul 08 21:12:06.369967 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:06.369929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f4744-nr969" event={"ID":"7231457c-b1ac-42a4-bc55-2b676305b837","Type":"ContainerStarted","Data":"9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059"}
Jul 08 21:12:06.370399 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:06.369984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f4744-nr969" event={"ID":"7231457c-b1ac-42a4-bc55-2b676305b837","Type":"ContainerStarted","Data":"7583dffcfb1b3cac36b2f66cd083a58f20aeb7fcc774bc3f74b63bccf0377a77"}
Jul 08 21:12:06.385162 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:06.385106    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-577c4f4744-nr969" podStartSLOduration=1.385091005 podStartE2EDuration="1.385091005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:12:06.384893837 +0000 UTC m=+364.636816039" watchObservedRunningTime="2026-07-08 21:12:06.385091005 +0000 UTC m=+364.637013206"
Jul 08 21:12:15.488857 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:15.488821    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:15.489247 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:15.488885    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:15.493705 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:15.493672    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:16.069522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.069459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:12:16.071772 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.071742    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a19b781d-37ae-40b6-b470-992503443eba-metrics-certs\") pod \"network-metrics-daemon-rnk9k\" (UID: \"a19b781d-37ae-40b6-b470-992503443eba\") " pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:12:16.307227 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.307194    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nfx9c\""
Jul 08 21:12:16.315048 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.315028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rnk9k"
Jul 08 21:12:16.408153 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.408123    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:12:16.442988 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.442961    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rnk9k"]
Jul 08 21:12:16.445338 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:12:16.445309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19b781d_37ae_40b6_b470_992503443eba.slice/crio-3260f70ce8ee57751cffe66a9c3ce53f3e36c446f1a3c73216888d892ac7be64 WatchSource:0}: Error finding container 3260f70ce8ee57751cffe66a9c3ce53f3e36c446f1a3c73216888d892ac7be64: Status 404 returned error can't find the container with id 3260f70ce8ee57751cffe66a9c3ce53f3e36c446f1a3c73216888d892ac7be64
Jul 08 21:12:16.447579 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:16.447558    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:12:17.409167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:17.409124    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rnk9k" event={"ID":"a19b781d-37ae-40b6-b470-992503443eba","Type":"ContainerStarted","Data":"3260f70ce8ee57751cffe66a9c3ce53f3e36c446f1a3c73216888d892ac7be64"}
Jul 08 21:12:18.414501 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:18.414463    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rnk9k" event={"ID":"a19b781d-37ae-40b6-b470-992503443eba","Type":"ContainerStarted","Data":"54c62971b4da9babbabba7013d81f31997edb129d35a5fbb15b58b14e268bf5c"}
Jul 08 21:12:18.414991 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:18.414528    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rnk9k" event={"ID":"a19b781d-37ae-40b6-b470-992503443eba","Type":"ContainerStarted","Data":"85850f3ede3a459d630ba45f4c9276c2c07a46e708b4ad0fb32da51b788fa208"}
Jul 08 21:12:18.430041 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:18.429990    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rnk9k" podStartSLOduration=375.306570888 podStartE2EDuration="6m16.429977469s" totalImagesPullingTime="1.123406581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:12:18.428611612 +0000 UTC m=+376.680533851" watchObservedRunningTime="2026-07-08 21:12:18.429977469 +0000 UTC m=+376.681899675"
Jul 08 21:12:56.691056 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.691021    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"]
Jul 08 21:12:56.694134 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.694116    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.696518 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.696488    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 21:12:56.696642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.696554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8fg9\""
Jul 08 21:12:56.697534 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.697515    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 21:12:56.701939 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.701913    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"]
Jul 08 21:12:56.800981 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.800949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.800981 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.800991    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.801206 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.801014    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btxw2\" (UniqueName: \"kubernetes.io/projected/ccaf3024-572a-48fd-b757-d28915dd1af5-kube-api-access-btxw2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.901408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.901350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.901408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.901416    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.901616 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.901448    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btxw2\" (UniqueName: \"kubernetes.io/projected/ccaf3024-572a-48fd-b757-d28915dd1af5-kube-api-access-btxw2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.901756 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.901736    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.901797 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.901769    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:56.909471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:56.909446    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btxw2\" (UniqueName: \"kubernetes.io/projected/ccaf3024-572a-48fd-b757-d28915dd1af5-kube-api-access-btxw2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:57.003942 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:57.003843    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:12:57.129136 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:57.129104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"]
Jul 08 21:12:57.133319 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:12:57.133293    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaf3024_572a_48fd_b757_d28915dd1af5.slice/crio-8be3c65b319ce05ce024ad414172da4747bc782c0f36897a7f0740d6dcae8d81 WatchSource:0}: Error finding container 8be3c65b319ce05ce024ad414172da4747bc782c0f36897a7f0740d6dcae8d81: Status 404 returned error can't find the container with id 8be3c65b319ce05ce024ad414172da4747bc782c0f36897a7f0740d6dcae8d81
Jul 08 21:12:57.557792 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:12:57.557758    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f" event={"ID":"ccaf3024-572a-48fd-b757-d28915dd1af5","Type":"ContainerStarted","Data":"8be3c65b319ce05ce024ad414172da4747bc782c0f36897a7f0740d6dcae8d81"}
Jul 08 21:13:07.599803 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:07.599771    2560 generic.go:356] "Generic (PLEG): container finished" podID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerID="ebd997cadcd424f901bcc1ad5269aee7a8bcda7ec20491c12b1afeca418bde74" exitCode=0
Jul 08 21:13:07.600167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:07.599829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f" event={"ID":"ccaf3024-572a-48fd-b757-d28915dd1af5","Type":"ContainerDied","Data":"ebd997cadcd424f901bcc1ad5269aee7a8bcda7ec20491c12b1afeca418bde74"}
Jul 08 21:13:10.610990 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:10.610954    2560 generic.go:356] "Generic (PLEG): container finished" podID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerID="53e58ed44ecece33c3b4002ee6972faab926b9da9874c5662214e05741e19484" exitCode=0
Jul 08 21:13:10.610990 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:10.610993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f" event={"ID":"ccaf3024-572a-48fd-b757-d28915dd1af5","Type":"ContainerDied","Data":"53e58ed44ecece33c3b4002ee6972faab926b9da9874c5662214e05741e19484"}
Jul 08 21:13:18.644953 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:18.644917    2560 generic.go:356] "Generic (PLEG): container finished" podID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerID="a44da899366064ee9abb188f74e64a43325318433f0dcfd98da9ec6ca5e3fa78" exitCode=0
Jul 08 21:13:18.645336 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:18.644959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f" event={"ID":"ccaf3024-572a-48fd-b757-d28915dd1af5","Type":"ContainerDied","Data":"a44da899366064ee9abb188f74e64a43325318433f0dcfd98da9ec6ca5e3fa78"}
Jul 08 21:13:19.776587 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.776563    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:13:19.879682 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.879643    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btxw2\" (UniqueName: \"kubernetes.io/projected/ccaf3024-572a-48fd-b757-d28915dd1af5-kube-api-access-btxw2\") pod \"ccaf3024-572a-48fd-b757-d28915dd1af5\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") "
Jul 08 21:13:19.879682 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.879685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-util\") pod \"ccaf3024-572a-48fd-b757-d28915dd1af5\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") "
Jul 08 21:13:19.879930 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.879714    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-bundle\") pod \"ccaf3024-572a-48fd-b757-d28915dd1af5\" (UID: \"ccaf3024-572a-48fd-b757-d28915dd1af5\") "
Jul 08 21:13:19.880492 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.880464    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-bundle" (OuterVolumeSpecName: "bundle") pod "ccaf3024-572a-48fd-b757-d28915dd1af5" (UID: "ccaf3024-572a-48fd-b757-d28915dd1af5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:13:19.881914 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.881895    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccaf3024-572a-48fd-b757-d28915dd1af5-kube-api-access-btxw2" (OuterVolumeSpecName: "kube-api-access-btxw2") pod "ccaf3024-572a-48fd-b757-d28915dd1af5" (UID: "ccaf3024-572a-48fd-b757-d28915dd1af5"). InnerVolumeSpecName "kube-api-access-btxw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:13:19.884854 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.884823    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-util" (OuterVolumeSpecName: "util") pod "ccaf3024-572a-48fd-b757-d28915dd1af5" (UID: "ccaf3024-572a-48fd-b757-d28915dd1af5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:13:19.980575 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.980503    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btxw2\" (UniqueName: \"kubernetes.io/projected/ccaf3024-572a-48fd-b757-d28915dd1af5-kube-api-access-btxw2\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:13:19.980575 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.980528    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-util\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:13:19.980575 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:19.980539    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ccaf3024-572a-48fd-b757-d28915dd1af5-bundle\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:13:20.653827 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:20.653790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f" event={"ID":"ccaf3024-572a-48fd-b757-d28915dd1af5","Type":"ContainerDied","Data":"8be3c65b319ce05ce024ad414172da4747bc782c0f36897a7f0740d6dcae8d81"}
Jul 08 21:13:20.653827 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:20.653807    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lr69f"
Jul 08 21:13:20.654062 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:20.653837    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8be3c65b319ce05ce024ad414172da4747bc782c0f36897a7f0740d6dcae8d81"
Jul 08 21:13:24.618637 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618561    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"]
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618806    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="util"
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618816    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="util"
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618830    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="extract"
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618835    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="extract"
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618847    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="pull"
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618853    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="pull"
Jul 08 21:13:24.619045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.618896    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccaf3024-572a-48fd-b757-d28915dd1af5" containerName="extract"
Jul 08 21:13:24.655232 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.655204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"]
Jul 08 21:13:24.655394 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.655296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.658066 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.658041    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 08 21:13:24.658209 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.658045    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:13:24.658209 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.658147    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5t2bq\""
Jul 08 21:13:24.714496 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.714462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwvvx\" (UniqueName: \"kubernetes.io/projected/13d8897b-33d1-4a15-bd4f-8a513453f237-kube-api-access-bwvvx\") pod \"cert-manager-operator-controller-manager-55c444bf86-qg6fb\" (UID: \"13d8897b-33d1-4a15-bd4f-8a513453f237\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.714658 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.714525    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13d8897b-33d1-4a15-bd4f-8a513453f237-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qg6fb\" (UID: \"13d8897b-33d1-4a15-bd4f-8a513453f237\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.815207 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.815171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwvvx\" (UniqueName: \"kubernetes.io/projected/13d8897b-33d1-4a15-bd4f-8a513453f237-kube-api-access-bwvvx\") pod \"cert-manager-operator-controller-manager-55c444bf86-qg6fb\" (UID: \"13d8897b-33d1-4a15-bd4f-8a513453f237\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.815386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.815231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13d8897b-33d1-4a15-bd4f-8a513453f237-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qg6fb\" (UID: \"13d8897b-33d1-4a15-bd4f-8a513453f237\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.815571 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.815555    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13d8897b-33d1-4a15-bd4f-8a513453f237-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qg6fb\" (UID: \"13d8897b-33d1-4a15-bd4f-8a513453f237\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.822847 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.822825    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwvvx\" (UniqueName: \"kubernetes.io/projected/13d8897b-33d1-4a15-bd4f-8a513453f237-kube-api-access-bwvvx\") pod \"cert-manager-operator-controller-manager-55c444bf86-qg6fb\" (UID: \"13d8897b-33d1-4a15-bd4f-8a513453f237\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:24.963680 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:24.963590    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"
Jul 08 21:13:25.108037 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:25.108005    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb"]
Jul 08 21:13:25.111952 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:13:25.111921    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d8897b_33d1_4a15_bd4f_8a513453f237.slice/crio-44e0d61fcf12e4be9d91288c545317e01769442db46e53ab912978515134e6e0 WatchSource:0}: Error finding container 44e0d61fcf12e4be9d91288c545317e01769442db46e53ab912978515134e6e0: Status 404 returned error can't find the container with id 44e0d61fcf12e4be9d91288c545317e01769442db46e53ab912978515134e6e0
Jul 08 21:13:25.675485 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:25.675450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb" event={"ID":"13d8897b-33d1-4a15-bd4f-8a513453f237","Type":"ContainerStarted","Data":"44e0d61fcf12e4be9d91288c545317e01769442db46e53ab912978515134e6e0"}
Jul 08 21:13:34.713601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:34.713564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb" event={"ID":"13d8897b-33d1-4a15-bd4f-8a513453f237","Type":"ContainerStarted","Data":"9fca92b8561d329f5a12c33417b6153a3e04634d9b4df41c3a99093fb89836f4"}
Jul 08 21:13:34.732747 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:34.732700    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qg6fb" podStartSLOduration=1.619688387 podStartE2EDuration="10.732685239s" totalImagesPullingTime="9.112996852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:13:34.732319667 +0000 UTC m=+452.984241870" watchObservedRunningTime="2026-07-08 21:13:34.732685239 +0000 UTC m=+452.984607441"
Jul 08 21:13:35.459619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.459582    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgqqr"]
Jul 08 21:13:35.461460 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.461444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.463909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.463889    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 21:13:35.463909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.463901    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g6hll\""
Jul 08 21:13:35.465663 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.465644    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 21:13:35.479835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.479811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgqqr"]
Jul 08 21:13:35.501501 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.501476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d1ff40-35eb-4318-b698-69fde0c0935f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgqqr\" (UID: \"49d1ff40-35eb-4318-b698-69fde0c0935f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.501614 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.501506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znzp8\" (UniqueName: \"kubernetes.io/projected/49d1ff40-35eb-4318-b698-69fde0c0935f-kube-api-access-znzp8\") pod \"cert-manager-webhook-6486ffd997-vgqqr\" (UID: \"49d1ff40-35eb-4318-b698-69fde0c0935f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.602913 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.602875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d1ff40-35eb-4318-b698-69fde0c0935f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgqqr\" (UID: \"49d1ff40-35eb-4318-b698-69fde0c0935f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.602913 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.602914    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znzp8\" (UniqueName: \"kubernetes.io/projected/49d1ff40-35eb-4318-b698-69fde0c0935f-kube-api-access-znzp8\") pod \"cert-manager-webhook-6486ffd997-vgqqr\" (UID: \"49d1ff40-35eb-4318-b698-69fde0c0935f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.610139 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.610112    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49d1ff40-35eb-4318-b698-69fde0c0935f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vgqqr\" (UID: \"49d1ff40-35eb-4318-b698-69fde0c0935f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.610423 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.610400    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znzp8\" (UniqueName: \"kubernetes.io/projected/49d1ff40-35eb-4318-b698-69fde0c0935f-kube-api-access-znzp8\") pod \"cert-manager-webhook-6486ffd997-vgqqr\" (UID: \"49d1ff40-35eb-4318-b698-69fde0c0935f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.781713 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.781634    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:35.907517 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:35.907442    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vgqqr"]
Jul 08 21:13:35.909571 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:13:35.909547    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49d1ff40_35eb_4318_b698_69fde0c0935f.slice/crio-c2f95588a032791f6daa5271e0cd66e1e686c8024da5227d98bf166eec884a50 WatchSource:0}: Error finding container c2f95588a032791f6daa5271e0cd66e1e686c8024da5227d98bf166eec884a50: Status 404 returned error can't find the container with id c2f95588a032791f6daa5271e0cd66e1e686c8024da5227d98bf166eec884a50
Jul 08 21:13:36.722192 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:36.722153    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr" event={"ID":"49d1ff40-35eb-4318-b698-69fde0c0935f","Type":"ContainerStarted","Data":"c2f95588a032791f6daa5271e0cd66e1e686c8024da5227d98bf166eec884a50"}
Jul 08 21:13:39.737171 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:39.737138    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr" event={"ID":"49d1ff40-35eb-4318-b698-69fde0c0935f","Type":"ContainerStarted","Data":"36d641ccf561ca380d28090b6592dfc95b3bcf08afa14abc530ea118ebe72600"}
Jul 08 21:13:39.737731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:39.737256    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:13:39.752255 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:39.752207    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr" podStartSLOduration=1.91096268 podStartE2EDuration="4.752191486s" totalImagesPullingTime="2.841228806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:13:39.750632578 +0000 UTC m=+458.002554780" watchObservedRunningTime="2026-07-08 21:13:39.752191486 +0000 UTC m=+458.004113688"
Jul 08 21:13:45.743656 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:13:45.743624    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vgqqr"
Jul 08 21:14:11.232314 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.232275    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"]
Jul 08 21:14:11.234576 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.234560    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.236757 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.236735    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 21:14:11.236757 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.236745    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 21:14:11.237665 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.237644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x8fg9\""
Jul 08 21:14:11.242421 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.242399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"]
Jul 08 21:14:11.391378 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.391342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.391578 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.391404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95tnq\" (UniqueName: \"kubernetes.io/projected/79cdb751-0074-4aaa-9765-a4057cea5500-kube-api-access-95tnq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.391578 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.391466    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.492841 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.492752    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.492841 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.492791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95tnq\" (UniqueName: \"kubernetes.io/projected/79cdb751-0074-4aaa-9765-a4057cea5500-kube-api-access-95tnq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.492841 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.492837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.493204 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.493184    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.493241 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.493218    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.501180 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.501151    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95tnq\" (UniqueName: \"kubernetes.io/projected/79cdb751-0074-4aaa-9765-a4057cea5500-kube-api-access-95tnq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.544229 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.544183    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:11.671682 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.671656    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"]
Jul 08 21:14:11.673730 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:14:11.673706    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79cdb751_0074_4aaa_9765_a4057cea5500.slice/crio-177bcb98e7ea76d1a0615081930585da7521c641180c5d7462a5a0d364809e3d WatchSource:0}: Error finding container 177bcb98e7ea76d1a0615081930585da7521c641180c5d7462a5a0d364809e3d: Status 404 returned error can't find the container with id 177bcb98e7ea76d1a0615081930585da7521c641180c5d7462a5a0d364809e3d
Jul 08 21:14:11.868064 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.868028    2560 generic.go:356] "Generic (PLEG): container finished" podID="79cdb751-0074-4aaa-9765-a4057cea5500" containerID="1d125f062f33805b9d66570afa3b72ddaf73bf9cd1004e81293bb9a2c21b24af" exitCode=0
Jul 08 21:14:11.868240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.868119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt" event={"ID":"79cdb751-0074-4aaa-9765-a4057cea5500","Type":"ContainerDied","Data":"1d125f062f33805b9d66570afa3b72ddaf73bf9cd1004e81293bb9a2c21b24af"}
Jul 08 21:14:11.868240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:11.868185    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt" event={"ID":"79cdb751-0074-4aaa-9765-a4057cea5500","Type":"ContainerStarted","Data":"177bcb98e7ea76d1a0615081930585da7521c641180c5d7462a5a0d364809e3d"}
Jul 08 21:14:12.874069 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:12.874033    2560 generic.go:356] "Generic (PLEG): container finished" podID="79cdb751-0074-4aaa-9765-a4057cea5500" containerID="b48505c0a2a82a21c08557c74795d61b16d42b2b9ce0757e612e64fb7a9b6e18" exitCode=0
Jul 08 21:14:12.874611 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:12.874080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt" event={"ID":"79cdb751-0074-4aaa-9765-a4057cea5500","Type":"ContainerDied","Data":"b48505c0a2a82a21c08557c74795d61b16d42b2b9ce0757e612e64fb7a9b6e18"}
Jul 08 21:14:13.880122 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:13.880090    2560 generic.go:356] "Generic (PLEG): container finished" podID="79cdb751-0074-4aaa-9765-a4057cea5500" containerID="b0b941a06a27e9a93a83fdfdde6842d2a1c6f389c3afdf3525703868e7612fd2" exitCode=0
Jul 08 21:14:13.880560 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:13.880163    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt" event={"ID":"79cdb751-0074-4aaa-9765-a4057cea5500","Type":"ContainerDied","Data":"b0b941a06a27e9a93a83fdfdde6842d2a1c6f389c3afdf3525703868e7612fd2"}
Jul 08 21:14:15.006467 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.006443    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:15.122087 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.122040    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-util\") pod \"79cdb751-0074-4aaa-9765-a4057cea5500\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") "
Jul 08 21:14:15.122087 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.122100    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-bundle\") pod \"79cdb751-0074-4aaa-9765-a4057cea5500\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") "
Jul 08 21:14:15.122339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.122168    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95tnq\" (UniqueName: \"kubernetes.io/projected/79cdb751-0074-4aaa-9765-a4057cea5500-kube-api-access-95tnq\") pod \"79cdb751-0074-4aaa-9765-a4057cea5500\" (UID: \"79cdb751-0074-4aaa-9765-a4057cea5500\") "
Jul 08 21:14:15.122965 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.122938    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-bundle" (OuterVolumeSpecName: "bundle") pod "79cdb751-0074-4aaa-9765-a4057cea5500" (UID: "79cdb751-0074-4aaa-9765-a4057cea5500"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:14:15.124268 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.124242    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79cdb751-0074-4aaa-9765-a4057cea5500-kube-api-access-95tnq" (OuterVolumeSpecName: "kube-api-access-95tnq") pod "79cdb751-0074-4aaa-9765-a4057cea5500" (UID: "79cdb751-0074-4aaa-9765-a4057cea5500"). InnerVolumeSpecName "kube-api-access-95tnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:14:15.127890 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.127869    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-util" (OuterVolumeSpecName: "util") pod "79cdb751-0074-4aaa-9765-a4057cea5500" (UID: "79cdb751-0074-4aaa-9765-a4057cea5500"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:14:15.223471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.223395    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-util\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:14:15.223471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.223421    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79cdb751-0074-4aaa-9765-a4057cea5500-bundle\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:14:15.223471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.223433    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95tnq\" (UniqueName: \"kubernetes.io/projected/79cdb751-0074-4aaa-9765-a4057cea5500-kube-api-access-95tnq\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:14:15.888820 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.888785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt" event={"ID":"79cdb751-0074-4aaa-9765-a4057cea5500","Type":"ContainerDied","Data":"177bcb98e7ea76d1a0615081930585da7521c641180c5d7462a5a0d364809e3d"}
Jul 08 21:14:15.888990 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.888825    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aflvrtt"
Jul 08 21:14:15.888990 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:15.888831    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="177bcb98e7ea76d1a0615081930585da7521c641180c5d7462a5a0d364809e3d"
Jul 08 21:14:23.831087 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831048    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"]
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831329    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="pull"
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831341    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="pull"
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831349    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="util"
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831355    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="util"
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831381    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="extract"
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831388    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="extract"
Jul 08 21:14:23.831494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.831432    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="79cdb751-0074-4aaa-9765-a4057cea5500" containerName="extract"
Jul 08 21:14:23.834157 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.834140    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.838108 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.838074    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mbpgv\""
Jul 08 21:14:23.838239 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.838122    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 21:14:23.838239 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.838076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 21:14:23.838239 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.838075    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 21:14:23.838239 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.838075    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 21:14:23.838429 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.838082    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 21:14:23.844029 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.844007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"]
Jul 08 21:14:23.881557 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.881524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-metrics-cert\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.881732 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.881600    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-cert\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.881732 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.881635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvvg\" (UniqueName: \"kubernetes.io/projected/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-kube-api-access-kdvvg\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.881732 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.881669    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-manager-config\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.982751 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.982716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-cert\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.982916 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.982761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvvg\" (UniqueName: \"kubernetes.io/projected/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-kube-api-access-kdvvg\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.982916 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.982788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-manager-config\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.982916 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.982816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-metrics-cert\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.983503 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.983472    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-manager-config\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.985178 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.985157    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-metrics-cert\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.985250 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.985192    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-cert\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:23.993522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:23.993494    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvvg\" (UniqueName: \"kubernetes.io/projected/2aa36f98-5f3f-44dd-9e7c-b2f9839efb33-kube-api-access-kdvvg\") pod \"lws-controller-manager-66869b5f86-wf6gz\" (UID: \"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33\") " pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:24.144134 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:24.144090    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:24.275019 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:24.274991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"]
Jul 08 21:14:24.277506 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:14:24.277478    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa36f98_5f3f_44dd_9e7c_b2f9839efb33.slice/crio-8c2800d1542d060c0e3a3c196d2dcc0cb5437df9adb60ef443de4dc7062a4818 WatchSource:0}: Error finding container 8c2800d1542d060c0e3a3c196d2dcc0cb5437df9adb60ef443de4dc7062a4818: Status 404 returned error can't find the container with id 8c2800d1542d060c0e3a3c196d2dcc0cb5437df9adb60ef443de4dc7062a4818
Jul 08 21:14:24.924880 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:24.924844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz" event={"ID":"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33","Type":"ContainerStarted","Data":"8c2800d1542d060c0e3a3c196d2dcc0cb5437df9adb60ef443de4dc7062a4818"}
Jul 08 21:14:25.002496 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.002463    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"]
Jul 08 21:14:25.006237 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.006219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.008982 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.008962    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w5666\""
Jul 08 21:14:25.009088 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.008961    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 21:14:25.009355 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.009340    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 21:14:25.009612 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.009597    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 21:14:25.009684 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.009654    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 21:14:25.018879 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.018834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"]
Jul 08 21:14:25.089420 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.089359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2srn\" (UniqueName: \"kubernetes.io/projected/49f3e879-ff31-4d80-9355-2a13164b84f6-kube-api-access-v2srn\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.089619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.089443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f3e879-ff31-4d80-9355-2a13164b84f6-tmp\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.089619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.089489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49f3e879-ff31-4d80-9355-2a13164b84f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.089619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.089527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49f3e879-ff31-4d80-9355-2a13164b84f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.089619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.089555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49f3e879-ff31-4d80-9355-2a13164b84f6-manifests\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.190125 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.190025    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49f3e879-ff31-4d80-9355-2a13164b84f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.190125 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.190082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49f3e879-ff31-4d80-9355-2a13164b84f6-manifests\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.190344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.190165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2srn\" (UniqueName: \"kubernetes.io/projected/49f3e879-ff31-4d80-9355-2a13164b84f6-kube-api-access-v2srn\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.190344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.190192    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f3e879-ff31-4d80-9355-2a13164b84f6-tmp\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.190344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.190230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49f3e879-ff31-4d80-9355-2a13164b84f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.190917 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.190880    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/49f3e879-ff31-4d80-9355-2a13164b84f6-manifests\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.193445 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.193387    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49f3e879-ff31-4d80-9355-2a13164b84f6-tmp\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.193618 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.193579    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49f3e879-ff31-4d80-9355-2a13164b84f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.195050 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.195006    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/49f3e879-ff31-4d80-9355-2a13164b84f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.202355 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.202305    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2srn\" (UniqueName: \"kubernetes.io/projected/49f3e879-ff31-4d80-9355-2a13164b84f6-kube-api-access-v2srn\") pod \"opendatahub-operator-controller-manager-94bc986b9-v9r46\" (UID: \"49f3e879-ff31-4d80-9355-2a13164b84f6\") " pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.317145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.317094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:25.506856 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:14:25.506812    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f3e879_ff31_4d80_9355_2a13164b84f6.slice/crio-e04cede4d50ab39161fbb2cab4f5b0e709a580687aff29cbb3765a319c39b71c WatchSource:0}: Error finding container e04cede4d50ab39161fbb2cab4f5b0e709a580687aff29cbb3765a319c39b71c: Status 404 returned error can't find the container with id e04cede4d50ab39161fbb2cab4f5b0e709a580687aff29cbb3765a319c39b71c
Jul 08 21:14:25.508133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.508041    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"]
Jul 08 21:14:25.931998 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:25.931959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46" event={"ID":"49f3e879-ff31-4d80-9355-2a13164b84f6","Type":"ContainerStarted","Data":"e04cede4d50ab39161fbb2cab4f5b0e709a580687aff29cbb3765a319c39b71c"}
Jul 08 21:14:26.944135 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:26.944046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz" event={"ID":"2aa36f98-5f3f-44dd-9e7c-b2f9839efb33","Type":"ContainerStarted","Data":"aa7124c02144909f280a09275178598460ac1b4a43be4d8fe0775848e999a937"}
Jul 08 21:14:26.944607 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:26.944242    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:26.984092 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:26.983071    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz" podStartSLOduration=1.461951075 podStartE2EDuration="3.983048764s" totalImagesPullingTime="2.521097689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:14:26.982231356 +0000 UTC m=+505.234153568" watchObservedRunningTime="2026-07-08 21:14:26.983048764 +0000 UTC m=+505.234970966"
Jul 08 21:14:29.959752 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:29.959713    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46" event={"ID":"49f3e879-ff31-4d80-9355-2a13164b84f6","Type":"ContainerStarted","Data":"630b87412d4fcec6a36c2cd500d95b5bf65844c0a4f4add20c9cba8bedde9151"}
Jul 08 21:14:30.965437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:30.965397    2560 generic.go:356] "Generic (PLEG): container finished" podID="49f3e879-ff31-4d80-9355-2a13164b84f6" containerID="630b87412d4fcec6a36c2cd500d95b5bf65844c0a4f4add20c9cba8bedde9151" exitCode=0
Jul 08 21:14:30.965802 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:30.965481    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46" event={"ID":"49f3e879-ff31-4d80-9355-2a13164b84f6","Type":"ContainerDied","Data":"630b87412d4fcec6a36c2cd500d95b5bf65844c0a4f4add20c9cba8bedde9151"}
Jul 08 21:14:31.971978 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:31.971938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46" event={"ID":"49f3e879-ff31-4d80-9355-2a13164b84f6","Type":"ContainerStarted","Data":"315d142cae33f286baabcb97d47ecd88cdfed0f48ec54435b1745f718c3e8e96"}
Jul 08 21:14:31.972350 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:31.972074    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:31.989254 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:31.989209    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46" podStartSLOduration=2.859500272 podStartE2EDuration="7.989193551s" totalImagesPullingTime="4.039154897s" totalInitContainerRuntime="1.090538382s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:14:31.989041563 +0000 UTC m=+510.240963765" watchObservedRunningTime="2026-07-08 21:14:31.989193551 +0000 UTC m=+510.241115752"
Jul 08 21:14:37.951771 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:37.951735    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66869b5f86-wf6gz"
Jul 08 21:14:42.978509 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:42.978478    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94bc986b9-v9r46"
Jul 08 21:14:48.072490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.072457    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"]
Jul 08 21:14:48.088629 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.088584    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"]
Jul 08 21:14:48.088799 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.088705    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.091464 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.091441    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 21:14:48.091594 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.091441    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 21:14:48.091669 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.091638    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lgtl9\""
Jul 08 21:14:48.173475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.173436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a2c001d-5073-4744-b239-eb76e8399968-tls-certs\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.173475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.173481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4wm\" (UniqueName: \"kubernetes.io/projected/5a2c001d-5073-4744-b239-eb76e8399968-kube-api-access-ps4wm\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.173697 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.173517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2c001d-5073-4744-b239-eb76e8399968-tmp\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.274222 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.274183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a2c001d-5073-4744-b239-eb76e8399968-tls-certs\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.274222 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.274224    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4wm\" (UniqueName: \"kubernetes.io/projected/5a2c001d-5073-4744-b239-eb76e8399968-kube-api-access-ps4wm\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.274538 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.274257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2c001d-5073-4744-b239-eb76e8399968-tmp\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.274538 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:14:48.274344    2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 08 21:14:48.274538 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:14:48.274442    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2c001d-5073-4744-b239-eb76e8399968-tls-certs podName:5a2c001d-5073-4744-b239-eb76e8399968 nodeName:}" failed. No retries permitted until 2026-07-08 21:14:48.774424154 +0000 UTC m=+527.026346355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5a2c001d-5073-4744-b239-eb76e8399968-tls-certs") pod "kube-auth-proxy-5d7c4b48c4-hpzcf" (UID: "5a2c001d-5073-4744-b239-eb76e8399968") : secret "kube-auth-proxy-tls" not found
Jul 08 21:14:48.276557 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.276535    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2c001d-5073-4744-b239-eb76e8399968-tmp\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.282694 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.282668    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4wm\" (UniqueName: \"kubernetes.io/projected/5a2c001d-5073-4744-b239-eb76e8399968-kube-api-access-ps4wm\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.778427 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.778389    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a2c001d-5073-4744-b239-eb76e8399968-tls-certs\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.780776 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.780754    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a2c001d-5073-4744-b239-eb76e8399968-tls-certs\") pod \"kube-auth-proxy-5d7c4b48c4-hpzcf\" (UID: \"5a2c001d-5073-4744-b239-eb76e8399968\") " pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:48.998437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:48.998394    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"
Jul 08 21:14:49.125059 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:49.125022    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf"]
Jul 08 21:14:49.127190 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:14:49.127162    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2c001d_5073_4744_b239_eb76e8399968.slice/crio-8987ee8b2dfdd85126f387fc9ff48477fa80340b243cc86db5057619c6603053 WatchSource:0}: Error finding container 8987ee8b2dfdd85126f387fc9ff48477fa80340b243cc86db5057619c6603053: Status 404 returned error can't find the container with id 8987ee8b2dfdd85126f387fc9ff48477fa80340b243cc86db5057619c6603053
Jul 08 21:14:50.054268 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:50.054225    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf" event={"ID":"5a2c001d-5073-4744-b239-eb76e8399968","Type":"ContainerStarted","Data":"8987ee8b2dfdd85126f387fc9ff48477fa80340b243cc86db5057619c6603053"}
Jul 08 21:14:54.072001 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:54.071911    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf" event={"ID":"5a2c001d-5073-4744-b239-eb76e8399968","Type":"ContainerStarted","Data":"7dd93f582512611c3e66567560a5d0246a569a51d5fa429599f0db60489f6666"}
Jul 08 21:14:54.089804 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:54.089753    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d7c4b48c4-hpzcf" podStartSLOduration=1.7423698349999999 podStartE2EDuration="6.089739241s" totalImagesPullingTime="4.347369406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:14:54.087919605 +0000 UTC m=+532.339841804" watchObservedRunningTime="2026-07-08 21:14:54.089739241 +0000 UTC m=+532.341661481"
Jul 08 21:14:57.319076 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.319045    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"]
Jul 08 21:14:57.322402 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.322379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.324692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.324655    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 21:14:57.324819 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.324796    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xszhm\""
Jul 08 21:14:57.333241 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.333219    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"]
Jul 08 21:14:57.447804 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.447772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrm8\" (UniqueName: \"kubernetes.io/projected/caa5d730-885a-4521-8bc4-a205cca21a33-kube-api-access-csrm8\") pod \"llmisvc-controller-manager-777c6bd7d5-ptnzp\" (UID: \"caa5d730-885a-4521-8bc4-a205cca21a33\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.448016 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.447830    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caa5d730-885a-4521-8bc4-a205cca21a33-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ptnzp\" (UID: \"caa5d730-885a-4521-8bc4-a205cca21a33\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.555388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.548476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrm8\" (UniqueName: \"kubernetes.io/projected/caa5d730-885a-4521-8bc4-a205cca21a33-kube-api-access-csrm8\") pod \"llmisvc-controller-manager-777c6bd7d5-ptnzp\" (UID: \"caa5d730-885a-4521-8bc4-a205cca21a33\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.555388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.548578    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caa5d730-885a-4521-8bc4-a205cca21a33-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ptnzp\" (UID: \"caa5d730-885a-4521-8bc4-a205cca21a33\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.555388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.551792    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/caa5d730-885a-4521-8bc4-a205cca21a33-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ptnzp\" (UID: \"caa5d730-885a-4521-8bc4-a205cca21a33\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.566193 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.566149    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrm8\" (UniqueName: \"kubernetes.io/projected/caa5d730-885a-4521-8bc4-a205cca21a33-kube-api-access-csrm8\") pod \"llmisvc-controller-manager-777c6bd7d5-ptnzp\" (UID: \"caa5d730-885a-4521-8bc4-a205cca21a33\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.635768 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.635738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:14:57.771917 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:57.771887    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"]
Jul 08 21:14:57.773770 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:14:57.773737    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcaa5d730_885a_4521_8bc4_a205cca21a33.slice/crio-cd1616ad001634ad1672201cadc9ebe909b143c870539c1e3801a4373e541cd0 WatchSource:0}: Error finding container cd1616ad001634ad1672201cadc9ebe909b143c870539c1e3801a4373e541cd0: Status 404 returned error can't find the container with id cd1616ad001634ad1672201cadc9ebe909b143c870539c1e3801a4373e541cd0
Jul 08 21:14:58.089428 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:14:58.089400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp" event={"ID":"caa5d730-885a-4521-8bc4-a205cca21a33","Type":"ContainerStarted","Data":"cd1616ad001634ad1672201cadc9ebe909b143c870539c1e3801a4373e541cd0"}
Jul 08 21:15:01.111619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:15:01.111588    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp" event={"ID":"caa5d730-885a-4521-8bc4-a205cca21a33","Type":"ContainerStarted","Data":"1cfc1912f885926dceb0afa24ccb5a1a9d2ab05c98c1acdbf534fc6d45429672"}
Jul 08 21:15:01.111967 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:15:01.111707    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:15:01.127864 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:15:01.127819    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp" podStartSLOduration=0.920391469 podStartE2EDuration="4.127805171s" totalImagesPullingTime="3.207413702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:15:01.127424776 +0000 UTC m=+539.379346972" watchObservedRunningTime="2026-07-08 21:15:01.127805171 +0000 UTC m=+539.379727394"
Jul 08 21:15:32.117610 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:15:32.117579    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ptnzp"
Jul 08 21:16:03.330760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.330729    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"]
Jul 08 21:16:03.334001 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.333984    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.339478 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.336858    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 21:16:03.339478 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.337113    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 21:16:03.339478 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.337658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dfkr2\""
Jul 08 21:16:03.343210 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.343187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"]
Jul 08 21:16:03.382837 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.382806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.382992 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.382847    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7knd\" (UniqueName: \"kubernetes.io/projected/41adf124-085a-43d5-a633-2c2e439cadd6-kube-api-access-q7knd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.382992 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.382884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.483463 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.483419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.483659 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.483480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7knd\" (UniqueName: \"kubernetes.io/projected/41adf124-085a-43d5-a633-2c2e439cadd6-kube-api-access-q7knd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.483659 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.483536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.483875 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.483851    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.483940 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.483887    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.493380 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.493345    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7knd\" (UniqueName: \"kubernetes.io/projected/41adf124-085a-43d5-a633-2c2e439cadd6-kube-api-access-q7knd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.649165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.649125    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:03.777225 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:03.777205    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"]
Jul 08 21:16:03.779417 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:16:03.779390    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41adf124_085a_43d5_a633_2c2e439cadd6.slice/crio-5a2c32fad2220b36083628c6c0ce229dd317e40673b39eb667d9a47391065595 WatchSource:0}: Error finding container 5a2c32fad2220b36083628c6c0ce229dd317e40673b39eb667d9a47391065595: Status 404 returned error can't find the container with id 5a2c32fad2220b36083628c6c0ce229dd317e40673b39eb667d9a47391065595
Jul 08 21:16:04.382176 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:04.382137    2560 generic.go:356] "Generic (PLEG): container finished" podID="41adf124-085a-43d5-a633-2c2e439cadd6" containerID="0d412df3fe04cd99fe902e0e7a967ca133349112c8b950cde33eab729d661002" exitCode=0
Jul 08 21:16:04.382596 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:04.382211    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm" event={"ID":"41adf124-085a-43d5-a633-2c2e439cadd6","Type":"ContainerDied","Data":"0d412df3fe04cd99fe902e0e7a967ca133349112c8b950cde33eab729d661002"}
Jul 08 21:16:04.382596 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:04.382254    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm" event={"ID":"41adf124-085a-43d5-a633-2c2e439cadd6","Type":"ContainerStarted","Data":"5a2c32fad2220b36083628c6c0ce229dd317e40673b39eb667d9a47391065595"}
Jul 08 21:16:05.388182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:05.388093    2560 generic.go:356] "Generic (PLEG): container finished" podID="41adf124-085a-43d5-a633-2c2e439cadd6" containerID="15d26e7afae281eca67ebd09c7e99b30db589b21bad654277c66127f3a58a71d" exitCode=0
Jul 08 21:16:05.388182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:05.388121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm" event={"ID":"41adf124-085a-43d5-a633-2c2e439cadd6","Type":"ContainerDied","Data":"15d26e7afae281eca67ebd09c7e99b30db589b21bad654277c66127f3a58a71d"}
Jul 08 21:16:06.394483 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:06.394451    2560 generic.go:356] "Generic (PLEG): container finished" podID="41adf124-085a-43d5-a633-2c2e439cadd6" containerID="d7c2588549e8395e2c203f44fe1935d350bf1854a0b12ca8a6f9eb28bbc7a51b" exitCode=0
Jul 08 21:16:06.394871 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:06.394539    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm" event={"ID":"41adf124-085a-43d5-a633-2c2e439cadd6","Type":"ContainerDied","Data":"d7c2588549e8395e2c203f44fe1935d350bf1854a0b12ca8a6f9eb28bbc7a51b"}
Jul 08 21:16:07.526104 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.526079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:07.618812 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.618775    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-util\") pod \"41adf124-085a-43d5-a633-2c2e439cadd6\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") "
Jul 08 21:16:07.618978 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.618845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7knd\" (UniqueName: \"kubernetes.io/projected/41adf124-085a-43d5-a633-2c2e439cadd6-kube-api-access-q7knd\") pod \"41adf124-085a-43d5-a633-2c2e439cadd6\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") "
Jul 08 21:16:07.618978 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.618916    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-bundle\") pod \"41adf124-085a-43d5-a633-2c2e439cadd6\" (UID: \"41adf124-085a-43d5-a633-2c2e439cadd6\") "
Jul 08 21:16:07.619431 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.619401    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-bundle" (OuterVolumeSpecName: "bundle") pod "41adf124-085a-43d5-a633-2c2e439cadd6" (UID: "41adf124-085a-43d5-a633-2c2e439cadd6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:07.620996 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.620972    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41adf124-085a-43d5-a633-2c2e439cadd6-kube-api-access-q7knd" (OuterVolumeSpecName: "kube-api-access-q7knd") pod "41adf124-085a-43d5-a633-2c2e439cadd6" (UID: "41adf124-085a-43d5-a633-2c2e439cadd6"). InnerVolumeSpecName "kube-api-access-q7knd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:16:07.624185 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.624163    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-util" (OuterVolumeSpecName: "util") pod "41adf124-085a-43d5-a633-2c2e439cadd6" (UID: "41adf124-085a-43d5-a633-2c2e439cadd6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:16:07.720424 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.720312    2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-bundle\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:07.720424 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.720347    2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41adf124-085a-43d5-a633-2c2e439cadd6-util\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:07.720424 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:07.720358    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7knd\" (UniqueName: \"kubernetes.io/projected/41adf124-085a-43d5-a633-2c2e439cadd6-kube-api-access-q7knd\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:08.404662 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:08.404620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm" event={"ID":"41adf124-085a-43d5-a633-2c2e439cadd6","Type":"ContainerDied","Data":"5a2c32fad2220b36083628c6c0ce229dd317e40673b39eb667d9a47391065595"}
Jul 08 21:16:08.404828 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:08.404680    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a2c32fad2220b36083628c6c0ce229dd317e40673b39eb667d9a47391065595"
Jul 08 21:16:08.404828 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:08.404637    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm"
Jul 08 21:16:16.567807 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:16.567763    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577c4f4744-nr969"]
Jul 08 21:16:41.589187 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.589129    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-577c4f4744-nr969" podUID="7231457c-b1ac-42a4-bc55-2b676305b837" containerName="console" containerID="cri-o://9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059" gracePeriod=15
Jul 08 21:16:41.840482 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.840425    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:16:41.908002 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.907974    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-trusted-ca-bundle\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908013    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-oauth-config\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhmtw\" (UniqueName: \"kubernetes.io/projected/7231457c-b1ac-42a4-bc55-2b676305b837-kube-api-access-rhmtw\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908078    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-oauth-serving-cert\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908103    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-console-config\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908117    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-service-ca\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908165 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-serving-cert\") pod \"7231457c-b1ac-42a4-bc55-2b676305b837\" (UID: \"7231457c-b1ac-42a4-bc55-2b676305b837\") "
Jul 08 21:16:41.908619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908578    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:16:41.908619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908591    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:16:41.908619 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908603    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-service-ca" (OuterVolumeSpecName: "service-ca") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:16:41.908749 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.908640    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-console-config" (OuterVolumeSpecName: "console-config") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 21:16:41.910236 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.910205    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7231457c-b1ac-42a4-bc55-2b676305b837-kube-api-access-rhmtw" (OuterVolumeSpecName: "kube-api-access-rhmtw") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "kube-api-access-rhmtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:16:41.910311 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.910281    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:16:41.910357 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:41.910309    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7231457c-b1ac-42a4-bc55-2b676305b837" (UID: "7231457c-b1ac-42a4-bc55-2b676305b837"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:16:42.009409 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009350    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-serving-cert\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.009409 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009401    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-trusted-ca-bundle\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.009409 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009412    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7231457c-b1ac-42a4-bc55-2b676305b837-console-oauth-config\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.009644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009421    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhmtw\" (UniqueName: \"kubernetes.io/projected/7231457c-b1ac-42a4-bc55-2b676305b837-kube-api-access-rhmtw\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.009644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009429    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-oauth-serving-cert\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.009644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009438    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-console-config\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.009644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.009447    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7231457c-b1ac-42a4-bc55-2b676305b837-service-ca\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:16:42.552481 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.552395    2560 generic.go:356] "Generic (PLEG): container finished" podID="7231457c-b1ac-42a4-bc55-2b676305b837" containerID="9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059" exitCode=0
Jul 08 21:16:42.552481 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.552441    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f4744-nr969" event={"ID":"7231457c-b1ac-42a4-bc55-2b676305b837","Type":"ContainerDied","Data":"9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059"}
Jul 08 21:16:42.552481 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.552480    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-577c4f4744-nr969" event={"ID":"7231457c-b1ac-42a4-bc55-2b676305b837","Type":"ContainerDied","Data":"7583dffcfb1b3cac36b2f66cd083a58f20aeb7fcc774bc3f74b63bccf0377a77"}
Jul 08 21:16:42.552726 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.552480    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-577c4f4744-nr969"
Jul 08 21:16:42.552726 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.552492    2560 scope.go:117] "RemoveContainer" containerID="9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059"
Jul 08 21:16:42.561169 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.561151    2560 scope.go:117] "RemoveContainer" containerID="9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059"
Jul 08 21:16:42.561426 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:16:42.561409    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059\": container with ID starting with 9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059 not found: ID does not exist" containerID="9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059"
Jul 08 21:16:42.561505 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.561431    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059"} err="failed to get container status \"9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059\": rpc error: code = NotFound desc = could not find container \"9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059\": container with ID starting with 9d40276f58db2673fd86daab573907ab677e6c9948e3d35e99a17a8b14b14059 not found: ID does not exist"
Jul 08 21:16:42.568161 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.568139    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-577c4f4744-nr969"]
Jul 08 21:16:42.571612 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:42.571593    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-577c4f4744-nr969"]
Jul 08 21:16:44.205190 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:16:44.205156    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7231457c-b1ac-42a4-bc55-2b676305b837" path="/var/lib/kubelet/pods/7231457c-b1ac-42a4-bc55-2b676305b837/volumes"
Jul 08 21:17:51.976033 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.975999    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976316    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7231457c-b1ac-42a4-bc55-2b676305b837" containerName="console"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976326    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7231457c-b1ac-42a4-bc55-2b676305b837" containerName="console"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976341    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="pull"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976346    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="pull"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976355    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="util"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976360    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="util"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976380    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="extract"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976386    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="extract"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976428    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="41adf124-085a-43d5-a633-2c2e439cadd6" containerName="extract"
Jul 08 21:17:51.976556 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.976436    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7231457c-b1ac-42a4-bc55-2b676305b837" containerName="console"
Jul 08 21:17:51.979396 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.979359    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:51.985343 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.985313    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 21:17:51.985663 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.985645    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 21:17:51.986095 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.986078    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 21:17:51.986178 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.986139    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dfkr2\""
Jul 08 21:17:51.992424 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:51.992405    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:17:52.003120 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.003086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:17:52.082111 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.082072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j5n8\" (UniqueName: \"kubernetes.io/projected/bddfa682-ac97-47f9-937e-b3f089d1e225-kube-api-access-8j5n8\") pod \"limitador-limitador-54d6d988d5-p558z\" (UID: \"bddfa682-ac97-47f9-937e-b3f089d1e225\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.082283 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.082124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bddfa682-ac97-47f9-937e-b3f089d1e225-config-file\") pod \"limitador-limitador-54d6d988d5-p558z\" (UID: \"bddfa682-ac97-47f9-937e-b3f089d1e225\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.182987 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.182950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j5n8\" (UniqueName: \"kubernetes.io/projected/bddfa682-ac97-47f9-937e-b3f089d1e225-kube-api-access-8j5n8\") pod \"limitador-limitador-54d6d988d5-p558z\" (UID: \"bddfa682-ac97-47f9-937e-b3f089d1e225\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.183186 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.182999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bddfa682-ac97-47f9-937e-b3f089d1e225-config-file\") pod \"limitador-limitador-54d6d988d5-p558z\" (UID: \"bddfa682-ac97-47f9-937e-b3f089d1e225\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.183616 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.183598    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bddfa682-ac97-47f9-937e-b3f089d1e225-config-file\") pod \"limitador-limitador-54d6d988d5-p558z\" (UID: \"bddfa682-ac97-47f9-937e-b3f089d1e225\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.190626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.190603    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j5n8\" (UniqueName: \"kubernetes.io/projected/bddfa682-ac97-47f9-937e-b3f089d1e225-kube-api-access-8j5n8\") pod \"limitador-limitador-54d6d988d5-p558z\" (UID: \"bddfa682-ac97-47f9-937e-b3f089d1e225\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.296123 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.296037    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:52.380573 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.380542    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-d9pj5"]
Jul 08 21:17:52.384051 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.384028    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:52.386903 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.386502    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lqktf\""
Jul 08 21:17:52.391345 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.391293    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9pj5"]
Jul 08 21:17:52.424105 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.424083    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:17:52.426661 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:17:52.426635    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbddfa682_ac97_47f9_937e_b3f089d1e225.slice/crio-e8c9fc5cb354b9f71a997575d513a9b01e676d673eb8a7546f75fe97c469a914 WatchSource:0}: Error finding container e8c9fc5cb354b9f71a997575d513a9b01e676d673eb8a7546f75fe97c469a914: Status 404 returned error can't find the container with id e8c9fc5cb354b9f71a997575d513a9b01e676d673eb8a7546f75fe97c469a914
Jul 08 21:17:52.429056 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.429036    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:17:52.485068 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.485032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knh6\" (UniqueName: \"kubernetes.io/projected/744fbc92-25d2-41e6-be78-8e4f5acd7693-kube-api-access-9knh6\") pod \"authorino-58cd955675-d9pj5\" (UID: \"744fbc92-25d2-41e6-be78-8e4f5acd7693\") " pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:52.585677 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.585602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knh6\" (UniqueName: \"kubernetes.io/projected/744fbc92-25d2-41e6-be78-8e4f5acd7693-kube-api-access-9knh6\") pod \"authorino-58cd955675-d9pj5\" (UID: \"744fbc92-25d2-41e6-be78-8e4f5acd7693\") " pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:52.593143 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.593113    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knh6\" (UniqueName: \"kubernetes.io/projected/744fbc92-25d2-41e6-be78-8e4f5acd7693-kube-api-access-9knh6\") pod \"authorino-58cd955675-d9pj5\" (UID: \"744fbc92-25d2-41e6-be78-8e4f5acd7693\") " pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:52.696163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.696127    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:52.819009 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.818981    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9pj5"]
Jul 08 21:17:52.821352 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:17:52.821326    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod744fbc92_25d2_41e6_be78_8e4f5acd7693.slice/crio-3f9f14decc8e817d23f60f7229d9be920f72cdbc856499cec9dfa2535cfc30b3 WatchSource:0}: Error finding container 3f9f14decc8e817d23f60f7229d9be920f72cdbc856499cec9dfa2535cfc30b3: Status 404 returned error can't find the container with id 3f9f14decc8e817d23f60f7229d9be920f72cdbc856499cec9dfa2535cfc30b3
Jul 08 21:17:52.849805 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.849769    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9pj5" event={"ID":"744fbc92-25d2-41e6-be78-8e4f5acd7693","Type":"ContainerStarted","Data":"3f9f14decc8e817d23f60f7229d9be920f72cdbc856499cec9dfa2535cfc30b3"}
Jul 08 21:17:52.850973 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:52.850951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z" event={"ID":"bddfa682-ac97-47f9-937e-b3f089d1e225","Type":"ContainerStarted","Data":"e8c9fc5cb354b9f71a997575d513a9b01e676d673eb8a7546f75fe97c469a914"}
Jul 08 21:17:56.998526 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:56.998497    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9pj5"]
Jul 08 21:17:57.881202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:57.881166    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9pj5" event={"ID":"744fbc92-25d2-41e6-be78-8e4f5acd7693","Type":"ContainerStarted","Data":"b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd"}
Jul 08 21:17:57.881202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:57.881195    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-d9pj5" podUID="744fbc92-25d2-41e6-be78-8e4f5acd7693" containerName="authorino" containerID="cri-o://b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd" gracePeriod=30
Jul 08 21:17:57.882845 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:57.882821    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z" event={"ID":"bddfa682-ac97-47f9-937e-b3f089d1e225","Type":"ContainerStarted","Data":"d644b7faf5f0d10e074a36da91c91ae65e6c2e151514a44e7919a80768afc35b"}
Jul 08 21:17:57.882941 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:57.882909    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:17:57.894653 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:57.894605    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-d9pj5" podStartSLOduration=1.698810673 podStartE2EDuration="5.894592294s" totalImagesPullingTime="4.195781621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:17:57.892997857 +0000 UTC m=+716.144920055" watchObservedRunningTime="2026-07-08 21:17:57.894592294 +0000 UTC m=+716.146514497"
Jul 08 21:17:57.910075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:57.910034    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z" podStartSLOduration=2.377471672 podStartE2EDuration="6.910021229s" totalImagesPullingTime="4.532549557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:17:57.909531695 +0000 UTC m=+716.161453899" watchObservedRunningTime="2026-07-08 21:17:57.910021229 +0000 UTC m=+716.161943472"
Jul 08 21:17:58.131839 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.131780    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:58.235673 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.235640    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9knh6\" (UniqueName: \"kubernetes.io/projected/744fbc92-25d2-41e6-be78-8e4f5acd7693-kube-api-access-9knh6\") pod \"744fbc92-25d2-41e6-be78-8e4f5acd7693\" (UID: \"744fbc92-25d2-41e6-be78-8e4f5acd7693\") "
Jul 08 21:17:58.237665 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.237641    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744fbc92-25d2-41e6-be78-8e4f5acd7693-kube-api-access-9knh6" (OuterVolumeSpecName: "kube-api-access-9knh6") pod "744fbc92-25d2-41e6-be78-8e4f5acd7693" (UID: "744fbc92-25d2-41e6-be78-8e4f5acd7693"). InnerVolumeSpecName "kube-api-access-9knh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:17:58.336855 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.336819    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9knh6\" (UniqueName: \"kubernetes.io/projected/744fbc92-25d2-41e6-be78-8e4f5acd7693-kube-api-access-9knh6\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:17:58.888102 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.888063    2560 generic.go:356] "Generic (PLEG): container finished" podID="744fbc92-25d2-41e6-be78-8e4f5acd7693" containerID="b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd" exitCode=0
Jul 08 21:17:58.888102 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.888105    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d9pj5"
Jul 08 21:17:58.888323 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.888145    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9pj5" event={"ID":"744fbc92-25d2-41e6-be78-8e4f5acd7693","Type":"ContainerDied","Data":"b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd"}
Jul 08 21:17:58.888323 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.888187    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d9pj5" event={"ID":"744fbc92-25d2-41e6-be78-8e4f5acd7693","Type":"ContainerDied","Data":"3f9f14decc8e817d23f60f7229d9be920f72cdbc856499cec9dfa2535cfc30b3"}
Jul 08 21:17:58.888323 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.888206    2560 scope.go:117] "RemoveContainer" containerID="b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd"
Jul 08 21:17:58.896427 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.896411    2560 scope.go:117] "RemoveContainer" containerID="b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd"
Jul 08 21:17:58.896670 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:17:58.896652    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd\": container with ID starting with b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd not found: ID does not exist" containerID="b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd"
Jul 08 21:17:58.896715 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.896678    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd"} err="failed to get container status \"b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd\": rpc error: code = NotFound desc = could not find container \"b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd\": container with ID starting with b7cfd16a8c8c197a9adae0ee498d252ccc8921328d1542b5755bd5b7a08faadd not found: ID does not exist"
Jul 08 21:17:58.907427 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.907404    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9pj5"]
Jul 08 21:17:58.909627 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:17:58.909607    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-d9pj5"]
Jul 08 21:18:00.206221 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:18:00.206184    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="744fbc92-25d2-41e6-be78-8e4f5acd7693" path="/var/lib/kubelet/pods/744fbc92-25d2-41e6-be78-8e4f5acd7693/volumes"
Jul 08 21:18:08.889161 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:18:08.889134    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-p558z"
Jul 08 21:19:07.975980 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:19:07.975944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:19:30.376735 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:19:30.376659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:19:37.284726 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:19:37.284688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:19:45.187766 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:19:45.187725    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:20:03.086427 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:03.086397    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:20:09.982081 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:09.982049    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:20:11.704241 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.704206    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"]
Jul 08 21:20:11.704632 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.704547    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="744fbc92-25d2-41e6-be78-8e4f5acd7693" containerName="authorino"
Jul 08 21:20:11.704632 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.704563    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="744fbc92-25d2-41e6-be78-8e4f5acd7693" containerName="authorino"
Jul 08 21:20:11.704632 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.704622    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="744fbc92-25d2-41e6-be78-8e4f5acd7693" containerName="authorino"
Jul 08 21:20:11.707549 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.707531    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.709814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.709791    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2tfz7\""
Jul 08 21:20:11.709814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.709794    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 21:20:11.710719 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.710699    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 21:20:11.710830 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.710775    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 08 21:20:11.717509 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.717489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"]
Jul 08 21:20:11.831305 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.831269    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xb5c\" (UniqueName: \"kubernetes.io/projected/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-kube-api-access-7xb5c\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.831473 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.831318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.831473 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.831382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.831473 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.831432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.831473 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.831467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.831608 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.831514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.932848 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.932811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.932855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xb5c\" (UniqueName: \"kubernetes.io/projected/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-kube-api-access-7xb5c\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.932887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.932910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.932941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.932977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933685 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.933657    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933882 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.933657    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.933987 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.933723    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.936066 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.936034    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.936320 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.936293    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:11.940804 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:11.940778    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xb5c\" (UniqueName: \"kubernetes.io/projected/5f267027-ddd3-4e9a-83cf-8434f2c77bb7-kube-api-access-7xb5c\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck\" (UID: \"5f267027-ddd3-4e9a-83cf-8434f2c77bb7\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:12.016591 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:12.016501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:12.144842 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:12.144813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"]
Jul 08 21:20:12.146953 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:20:12.146929    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f267027_ddd3_4e9a_83cf_8434f2c77bb7.slice/crio-c87898f57397da8f275638fa588815723148f18e8a4aa85c91b6e82c4716ff3f WatchSource:0}: Error finding container c87898f57397da8f275638fa588815723148f18e8a4aa85c91b6e82c4716ff3f: Status 404 returned error can't find the container with id c87898f57397da8f275638fa588815723148f18e8a4aa85c91b6e82c4716ff3f
Jul 08 21:20:12.468214 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:12.468176    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck" event={"ID":"5f267027-ddd3-4e9a-83cf-8434f2c77bb7","Type":"ContainerStarted","Data":"c87898f57397da8f275638fa588815723148f18e8a4aa85c91b6e82c4716ff3f"}
Jul 08 21:20:14.477463 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:14.477426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck" event={"ID":"5f267027-ddd3-4e9a-83cf-8434f2c77bb7","Type":"ContainerStarted","Data":"cca1b377cf730e010de1e83d68309fabff3a49dc95eb3ff899912fcb6e61be16"}
Jul 08 21:20:14.494144 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:14.494097    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck" podStartSLOduration=1.808358643 podStartE2EDuration="3.494084327s" totalImagesPullingTime="1.685725684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:20:14.491902261 +0000 UTC m=+852.743824475" watchObservedRunningTime="2026-07-08 21:20:14.494084327 +0000 UTC m=+852.746006529"
Jul 08 21:20:19.185414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:19.185378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:20:22.017202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:22.017155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:22.017692 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:22.017227    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:22.029745 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:22.029718    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:20:22.523622 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:20:22.523589    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck"
Jul 08 21:21:11.082173 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.082139    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-596fcc8767-n7nfk"]
Jul 08 21:21:11.084886 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.084857    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.088973 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.088943    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 21:21:11.089596 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.089177    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lqktf\""
Jul 08 21:21:11.092382 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.092339    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-596fcc8767-n7nfk"]
Jul 08 21:21:11.188936 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.188904    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7rrz\" (UniqueName: \"kubernetes.io/projected/1f09b0f4-6694-4fff-8338-c41cf90caf61-kube-api-access-d7rrz\") pod \"authorino-596fcc8767-n7nfk\" (UID: \"1f09b0f4-6694-4fff-8338-c41cf90caf61\") " pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.189087 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.188949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f09b0f4-6694-4fff-8338-c41cf90caf61-tls-cert\") pod \"authorino-596fcc8767-n7nfk\" (UID: \"1f09b0f4-6694-4fff-8338-c41cf90caf61\") " pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.289609 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.289572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f09b0f4-6694-4fff-8338-c41cf90caf61-tls-cert\") pod \"authorino-596fcc8767-n7nfk\" (UID: \"1f09b0f4-6694-4fff-8338-c41cf90caf61\") " pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.289753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.289654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7rrz\" (UniqueName: \"kubernetes.io/projected/1f09b0f4-6694-4fff-8338-c41cf90caf61-kube-api-access-d7rrz\") pod \"authorino-596fcc8767-n7nfk\" (UID: \"1f09b0f4-6694-4fff-8338-c41cf90caf61\") " pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.292113 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.292080    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1f09b0f4-6694-4fff-8338-c41cf90caf61-tls-cert\") pod \"authorino-596fcc8767-n7nfk\" (UID: \"1f09b0f4-6694-4fff-8338-c41cf90caf61\") " pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.297154 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.297119    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7rrz\" (UniqueName: \"kubernetes.io/projected/1f09b0f4-6694-4fff-8338-c41cf90caf61-kube-api-access-d7rrz\") pod \"authorino-596fcc8767-n7nfk\" (UID: \"1f09b0f4-6694-4fff-8338-c41cf90caf61\") " pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.399239 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.399202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-596fcc8767-n7nfk"
Jul 08 21:21:11.526179 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.526152    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-596fcc8767-n7nfk"]
Jul 08 21:21:11.528706 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:21:11.528665    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f09b0f4_6694_4fff_8338_c41cf90caf61.slice/crio-08c4f173cc8b54b3de902719d71eb3d6215bf96bdf05c3ffcb0f37ec28f7c295 WatchSource:0}: Error finding container 08c4f173cc8b54b3de902719d71eb3d6215bf96bdf05c3ffcb0f37ec28f7c295: Status 404 returned error can't find the container with id 08c4f173cc8b54b3de902719d71eb3d6215bf96bdf05c3ffcb0f37ec28f7c295
Jul 08 21:21:11.722410 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:11.722313    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-596fcc8767-n7nfk" event={"ID":"1f09b0f4-6694-4fff-8338-c41cf90caf61","Type":"ContainerStarted","Data":"08c4f173cc8b54b3de902719d71eb3d6215bf96bdf05c3ffcb0f37ec28f7c295"}
Jul 08 21:21:12.729333 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:12.729296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-596fcc8767-n7nfk" event={"ID":"1f09b0f4-6694-4fff-8338-c41cf90caf61","Type":"ContainerStarted","Data":"b043df8ffdc04abda1a91bb619e974a06ef783aac660c106124406e6ea39f661"}
Jul 08 21:21:12.744324 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:12.744272    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-596fcc8767-n7nfk" podStartSLOduration=1.318208879 podStartE2EDuration="1.744254953s" totalImagesPullingTime="426.046074ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:21:12.743586145 +0000 UTC m=+910.995508348" watchObservedRunningTime="2026-07-08 21:21:12.744254953 +0000 UTC m=+910.996177156"
Jul 08 21:21:43.786896 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:43.786856    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:21:53.078383 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:21:53.078329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:22:04.882378 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:22:04.882327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:22:14.480425 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:22:14.480390    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:22:23.491972 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:22:23.491927    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:23:38.393457 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:23:38.393423    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:23:47.777953 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:23:47.777914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:23:56.391298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:23:56.391209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:24:05.681710 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:24:05.681675    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:24:15.384761 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:24:15.384727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:24:24.288820 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:24:24.288785    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:24:34.786231 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:24:34.786195    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:24:44.178998 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:24:44.178968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:25:07.478048 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:25:07.478012    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:25:17.786379 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:25:17.786331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:25:40.678459 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:25:40.678419    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:25:50.479482 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:25:50.479443    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:26:06.336681 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:26:06.336648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:26:16.884706 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:26:16.884656    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:26:26.086111 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:26:26.086072    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:26:35.183248 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:26:35.183210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:26:44.288142 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:26:44.288103    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:28:33.485024 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:28:33.484985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:28:42.581322 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:28:42.581288    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:28:56.580862 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:28:56.580827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:29:05.684752 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:29:05.684711    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:29:16.084157 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:29:16.084115    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:29:23.689930 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:29:23.689894    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:29:33.593785 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:29:33.593745    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:29:44.986598 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:29:44.986563    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:29:53.984662 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:29:53.984576    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:30:04.590471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:30:04.590434    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:30:15.986323 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:30:15.986284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:30:23.687437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:30:23.687393    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:30:41.795116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:30:41.795069    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:30:50.691760 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:30:50.691724    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:30:59.786625 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:30:59.786589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:31:09.086776 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:31:09.086726    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:31:25.977802 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:31:25.977714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:31:35.186514 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:31:35.186474    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:31:45.177789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:31:45.177754    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:31:54.086643 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:31:54.086605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:03.180207 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:03.180176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:12.377008 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:12.376973    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:18.284704 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:18.284656    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:27.780223 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:27.780187    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:37.490557 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:37.490512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:47.290029 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:47.289992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:32:56.476479 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:32:56.476399    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:33:08.585302 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:33:08.585257    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:33:16.586936 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:33:16.586899    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:33:26.788174 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:33:26.788135    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:33:38.190206 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:33:38.190165    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:33:47.286458 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:33:47.286416    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:33:57.983683 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:33:57.983641    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:34:06.978244 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:34:06.978194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:34:18.489804 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:34:18.489759    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:34:34.982487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:34:34.982401    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:34:46.076508 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:34:46.076472    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:34:53.683396 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:34:53.683345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:35:02.674732 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:35:02.674696    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:36:23.383447 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:36:23.383412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:36:31.987265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:36:31.987223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:36:45.089505 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:36:45.089460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:36:56.882469 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:36:56.882433    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:37:25.505734 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:25.505653    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:37:33.520055 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.520015    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"]
Jul 08 21:37:33.523480 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.523459    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.527139 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.527114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b837af85\"/\"e2e-lifecycle-model-b837af85-kserve-self-signed-certs\""
Jul 08 21:37:33.527258 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.527158    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b837af85\"/\"openshift-service-ca.crt\""
Jul 08 21:37:33.527258 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.527220    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b837af85\"/\"kube-root-ca.crt\""
Jul 08 21:37:33.527258 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.527228    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b837af85\"/\"default-dockercfg-pw8bf\""
Jul 08 21:37:33.531356 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.531334    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"]
Jul 08 21:37:33.621132 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.621094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tmp-dir\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.621132 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.621133    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7fbp\" (UniqueName: \"kubernetes.io/projected/a19d8140-8a50-4c1d-ae13-78b2255ff95c-kube-api-access-t7fbp\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.621337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.621153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-model-cache\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.621337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.621214    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tls-certs\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.621337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.621275    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-home\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.621337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.621304    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-dshm\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.722602 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.722563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-home\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.722602 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.722608    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-dshm\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.722816 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.722639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tmp-dir\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.722816 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.722658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7fbp\" (UniqueName: \"kubernetes.io/projected/a19d8140-8a50-4c1d-ae13-78b2255ff95c-kube-api-access-t7fbp\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.722816 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.722678    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-model-cache\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.722816 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.722699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tls-certs\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.723102 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.723072    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-home\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.723145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.723072    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tmp-dir\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.723145 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.723118    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-model-cache\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.725037 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.725013    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-dshm\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.725327 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.725307    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tls-certs\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.730816 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.730793    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7fbp\" (UniqueName: \"kubernetes.io/projected/a19d8140-8a50-4c1d-ae13-78b2255ff95c-kube-api-access-t7fbp\") pod \"e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") " pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.834246 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.834159    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:33.966212 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:33.965067    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"]
Jul 08 21:37:33.973619 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:37:33.973590    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda19d8140_8a50_4c1d_ae13_78b2255ff95c.slice/crio-23c0ca427f55a0d297dbd378b43afe2b1b31a588c24a42fcf0a9744b11625691 WatchSource:0}: Error finding container 23c0ca427f55a0d297dbd378b43afe2b1b31a588c24a42fcf0a9744b11625691: Status 404 returned error can't find the container with id 23c0ca427f55a0d297dbd378b43afe2b1b31a588c24a42fcf0a9744b11625691
Jul 08 21:37:34.106057 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:34.106020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs" event={"ID":"a19d8140-8a50-4c1d-ae13-78b2255ff95c","Type":"ContainerStarted","Data":"9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951"}
Jul 08 21:37:34.106057 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:34.106063    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs" event={"ID":"a19d8140-8a50-4c1d-ae13-78b2255ff95c","Type":"ContainerStarted","Data":"23c0ca427f55a0d297dbd378b43afe2b1b31a588c24a42fcf0a9744b11625691"}
Jul 08 21:37:34.123088 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:34.123033    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs" podStartSLOduration=1.123018369 podStartE2EDuration="1.123018369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:37:34.121493988 +0000 UTC m=+1892.373416184" watchObservedRunningTime="2026-07-08 21:37:34.123018369 +0000 UTC m=+1892.374940572"
Jul 08 21:37:36.683977 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:36.683942    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:37:43.835387 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:43.835322    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:43.835775 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:43.835405    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:43.847666 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:43.847640    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:44.160350 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:44.160315    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:37:51.195310 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:37:51.195275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:38:04.954383 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:04.954332    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"]
Jul 08 21:38:05.189902 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:05.189866    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:38:19.974606 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:19.974565    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs" podUID="a19d8140-8a50-4c1d-ae13-78b2255ff95c" containerName="main" containerID="cri-o://9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951" gracePeriod=45
Jul 08 21:38:20.224169 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.224144    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:38:20.307289 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.307199    2560 generic.go:356] "Generic (PLEG): container finished" podID="a19d8140-8a50-4c1d-ae13-78b2255ff95c" containerID="9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951" exitCode=0
Jul 08 21:38:20.307289 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.307252    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"
Jul 08 21:38:20.307532 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.307286    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs" event={"ID":"a19d8140-8a50-4c1d-ae13-78b2255ff95c","Type":"ContainerDied","Data":"9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951"}
Jul 08 21:38:20.307532 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.307329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs" event={"ID":"a19d8140-8a50-4c1d-ae13-78b2255ff95c","Type":"ContainerDied","Data":"23c0ca427f55a0d297dbd378b43afe2b1b31a588c24a42fcf0a9744b11625691"}
Jul 08 21:38:20.307532 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.307348    2560 scope.go:117] "RemoveContainer" containerID="9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951"
Jul 08 21:38:20.315261 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.315244    2560 scope.go:117] "RemoveContainer" containerID="9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951"
Jul 08 21:38:20.315526 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:38:20.315508    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951\": container with ID starting with 9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951 not found: ID does not exist" containerID="9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951"
Jul 08 21:38:20.315578 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.315535    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951"} err="failed to get container status \"9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951\": rpc error: code = NotFound desc = could not find container \"9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951\": container with ID starting with 9e60b274331cabbcdd51e4f8bac240a67effccf9c2c513162c35e4913a2cd951 not found: ID does not exist"
Jul 08 21:38:20.318835 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.318818    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7fbp\" (UniqueName: \"kubernetes.io/projected/a19d8140-8a50-4c1d-ae13-78b2255ff95c-kube-api-access-t7fbp\") pod \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") "
Jul 08 21:38:20.318908 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.318845    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tls-certs\") pod \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") "
Jul 08 21:38:20.318908 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.318889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-model-cache\") pod \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") "
Jul 08 21:38:20.319014 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.318932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tmp-dir\") pod \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") "
Jul 08 21:38:20.319014 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.318958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-home\") pod \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") "
Jul 08 21:38:20.319014 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.318981    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-dshm\") pod \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\" (UID: \"a19d8140-8a50-4c1d-ae13-78b2255ff95c\") "
Jul 08 21:38:20.319281 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.319249    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-home" (OuterVolumeSpecName: "home") pod "a19d8140-8a50-4c1d-ae13-78b2255ff95c" (UID: "a19d8140-8a50-4c1d-ae13-78b2255ff95c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:20.319281 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.319273    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a19d8140-8a50-4c1d-ae13-78b2255ff95c" (UID: "a19d8140-8a50-4c1d-ae13-78b2255ff95c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:20.319437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.319254    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-model-cache" (OuterVolumeSpecName: "model-cache") pod "a19d8140-8a50-4c1d-ae13-78b2255ff95c" (UID: "a19d8140-8a50-4c1d-ae13-78b2255ff95c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:20.321079 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.321056    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a19d8140-8a50-4c1d-ae13-78b2255ff95c-kube-api-access-t7fbp" (OuterVolumeSpecName: "kube-api-access-t7fbp") pod "a19d8140-8a50-4c1d-ae13-78b2255ff95c" (UID: "a19d8140-8a50-4c1d-ae13-78b2255ff95c"). InnerVolumeSpecName "kube-api-access-t7fbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:38:20.321158 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.321085    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a19d8140-8a50-4c1d-ae13-78b2255ff95c" (UID: "a19d8140-8a50-4c1d-ae13-78b2255ff95c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:38:20.321158 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.321085    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-dshm" (OuterVolumeSpecName: "dshm") pod "a19d8140-8a50-4c1d-ae13-78b2255ff95c" (UID: "a19d8140-8a50-4c1d-ae13-78b2255ff95c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:38:20.419615 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.419572    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7fbp\" (UniqueName: \"kubernetes.io/projected/a19d8140-8a50-4c1d-ae13-78b2255ff95c-kube-api-access-t7fbp\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:38:20.419615 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.419613    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:38:20.419615 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.419622    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:38:20.419615 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.419630    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:38:20.419875 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.419638    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:38:20.419875 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.419647    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a19d8140-8a50-4c1d-ae13-78b2255ff95c-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:38:20.627944 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.627901    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"]
Jul 08 21:38:20.636699 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:20.636675    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b837af85/e2e-lifecycle-model-b837af85-kserve-f9454dff5-jw4gs"]
Jul 08 21:38:22.210605 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:22.210572    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a19d8140-8a50-4c1d-ae13-78b2255ff95c" path="/var/lib/kubelet/pods/a19d8140-8a50-4c1d-ae13-78b2255ff95c/volumes"
Jul 08 21:38:45.585349 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:45.585312    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:38:53.602099 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:38:53.602057    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:39:04.592574 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:39:04.592537    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:39:54.388695 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:39:54.388660    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:40:05.419182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:05.419144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:40:07.425634 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.425599    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"]
Jul 08 21:40:07.426017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.425895    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19d8140-8a50-4c1d-ae13-78b2255ff95c" containerName="main"
Jul 08 21:40:07.426017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.425906    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19d8140-8a50-4c1d-ae13-78b2255ff95c" containerName="main"
Jul 08 21:40:07.426017 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.425969    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19d8140-8a50-4c1d-ae13-78b2255ff95c" containerName="main"
Jul 08 21:40:07.428873 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.428852    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.432394 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.432290    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a8920c\"/\"test-model-a8920c-kserve-self-signed-certs\""
Jul 08 21:40:07.432394 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.432343    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a8920c\"/\"default-dockercfg-7d29n\""
Jul 08 21:40:07.432585 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.432411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a8920c\"/\"kube-root-ca.crt\""
Jul 08 21:40:07.432585 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.432443    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a8920c\"/\"openshift-service-ca.crt\""
Jul 08 21:40:07.438127 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.438104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"]
Jul 08 21:40:07.533932 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.533891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-model-cache\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.534116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.533950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzmg\" (UniqueName: \"kubernetes.io/projected/db7d09c2-8971-4117-8fbb-73ae91e99647-kube-api-access-hbzmg\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.534116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.533992    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db7d09c2-8971-4117-8fbb-73ae91e99647-tls-certs\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.534116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.534012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-tmp-dir\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.534116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.534076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-home\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.534116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.534107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-dshm\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635204 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-home\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635204 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-dshm\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635239    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-model-cache\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635295    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzmg\" (UniqueName: \"kubernetes.io/projected/db7d09c2-8971-4117-8fbb-73ae91e99647-kube-api-access-hbzmg\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db7d09c2-8971-4117-8fbb-73ae91e99647-tls-certs\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635358    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-tmp-dir\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635763 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635740    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-model-cache\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635824 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635785    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-home\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.635824 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.635807    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-tmp-dir\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.637602 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.637581    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-dshm\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.637763 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.637736    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db7d09c2-8971-4117-8fbb-73ae91e99647-tls-certs\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.643015 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.642990    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzmg\" (UniqueName: \"kubernetes.io/projected/db7d09c2-8971-4117-8fbb-73ae91e99647-kube-api-access-hbzmg\") pod \"test-model-a8920c-kserve-7574c4487-xcw5c\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") " pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.738181 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.738091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:07.872994 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:07.872969    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"]
Jul 08 21:40:07.874914 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:40:07.874887    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb7d09c2_8971_4117_8fbb_73ae91e99647.slice/crio-5e4d43095dbd0031755a2e7b07abcade539defd3e78940acdbe149b110b806bb WatchSource:0}: Error finding container 5e4d43095dbd0031755a2e7b07abcade539defd3e78940acdbe149b110b806bb: Status 404 returned error can't find the container with id 5e4d43095dbd0031755a2e7b07abcade539defd3e78940acdbe149b110b806bb
Jul 08 21:40:08.798437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:08.798398    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c" event={"ID":"db7d09c2-8971-4117-8fbb-73ae91e99647","Type":"ContainerStarted","Data":"e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa"}
Jul 08 21:40:08.798814 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:08.798447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c" event={"ID":"db7d09c2-8971-4117-8fbb-73ae91e99647","Type":"ContainerStarted","Data":"5e4d43095dbd0031755a2e7b07abcade539defd3e78940acdbe149b110b806bb"}
Jul 08 21:40:08.816542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:08.816492    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c" podStartSLOduration=1.8164749059999998 podStartE2EDuration="1.816474906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:08.815431141 +0000 UTC m=+2047.067353343" watchObservedRunningTime="2026-07-08 21:40:08.816474906 +0000 UTC m=+2047.068397108"
Jul 08 21:40:17.200524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:17.200483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:40:17.739235 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:17.739194    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:17.739626 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:17.739609    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:17.753038 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:17.753006    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:17.849131 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:17.849103    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:40:39.420180 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.420141    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"]
Jul 08 21:40:39.423153 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.423133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.425534 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.425504    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e687ba\"/\"kube-root-ca.crt\""
Jul 08 21:40:39.425636 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.425507    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e687ba\"/\"openshift-service-ca.crt\""
Jul 08 21:40:39.426598 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.426581    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e687ba\"/\"default-dockercfg-7k2rr\""
Jul 08 21:40:39.426715 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.426627    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e687ba\"/\"test-model-e687ba-kserve-self-signed-certs\""
Jul 08 21:40:39.433220 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.433196    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"]
Jul 08 21:40:39.510186 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.510149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-model-cache\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.510186 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.510194    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tmp-dir\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.510443 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.510221    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tls-certs\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.510443 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.510308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8b5x\" (UniqueName: \"kubernetes.io/projected/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-kube-api-access-b8b5x\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.510443 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.510355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-home\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.510443 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.510409    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-dshm\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611146 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611103    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-model-cache\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611146 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611148    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tmp-dir\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tls-certs\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8b5x\" (UniqueName: \"kubernetes.io/projected/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-kube-api-access-b8b5x\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-home\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-dshm\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611635 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611609    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-model-cache\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611706 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611618    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tmp-dir\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.611706 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.611681    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-home\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.613606 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.613577    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-dshm\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.613734 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.613649    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tls-certs\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.619458 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.619434    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8b5x\" (UniqueName: \"kubernetes.io/projected/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-kube-api-access-b8b5x\") pod \"test-model-e687ba-kserve-596d5d5555-9t99s\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") " pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.733341 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.733255    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:39.872000 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.871974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"]
Jul 08 21:40:39.875253 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:40:39.875223    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3196f4a_eb15_44b7_abc8_dc44e6bd5488.slice/crio-3608c1b810c54ff7ca9e9fe3a9d23b6bef589a059084c0ee2a47fd674d4488d2 WatchSource:0}: Error finding container 3608c1b810c54ff7ca9e9fe3a9d23b6bef589a059084c0ee2a47fd674d4488d2: Status 404 returned error can't find the container with id 3608c1b810c54ff7ca9e9fe3a9d23b6bef589a059084c0ee2a47fd674d4488d2
Jul 08 21:40:39.933471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:39.933447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s" event={"ID":"e3196f4a-eb15-44b7-abc8-dc44e6bd5488","Type":"ContainerStarted","Data":"3608c1b810c54ff7ca9e9fe3a9d23b6bef589a059084c0ee2a47fd674d4488d2"}
Jul 08 21:40:40.939718 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:40.939681    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s" event={"ID":"e3196f4a-eb15-44b7-abc8-dc44e6bd5488","Type":"ContainerStarted","Data":"523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547"}
Jul 08 21:40:40.956638 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:40.956592    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s" podStartSLOduration=1.956578851 podStartE2EDuration="1.956578851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:40:40.955471232 +0000 UTC m=+2079.207393435" watchObservedRunningTime="2026-07-08 21:40:40.956578851 +0000 UTC m=+2079.208501031"
Jul 08 21:40:44.088113 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:44.088076    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:40:49.733572 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:49.733532    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:49.734028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:49.733594    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:49.747308 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:49.747282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:49.991691 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:49.991612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:40:57.679696 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:40:57.679659    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:41:13.725639 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:13.725605    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"]
Jul 08 21:41:14.651455 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:14.651424    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"]
Jul 08 21:41:19.082018 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:19.081977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:41:28.745595 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:28.745546    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c" podUID="db7d09c2-8971-4117-8fbb-73ae91e99647" containerName="main" containerID="cri-o://e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa" gracePeriod=45
Jul 08 21:41:29.001551 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.001492    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:41:29.122924 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.122889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-home\") pod \"db7d09c2-8971-4117-8fbb-73ae91e99647\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") "
Jul 08 21:41:29.122924 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.122931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-model-cache\") pod \"db7d09c2-8971-4117-8fbb-73ae91e99647\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") "
Jul 08 21:41:29.123167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123021    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-dshm\") pod \"db7d09c2-8971-4117-8fbb-73ae91e99647\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") "
Jul 08 21:41:29.123167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123105    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db7d09c2-8971-4117-8fbb-73ae91e99647-tls-certs\") pod \"db7d09c2-8971-4117-8fbb-73ae91e99647\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") "
Jul 08 21:41:29.123167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123129    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-tmp-dir\") pod \"db7d09c2-8971-4117-8fbb-73ae91e99647\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") "
Jul 08 21:41:29.123167 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123158    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbzmg\" (UniqueName: \"kubernetes.io/projected/db7d09c2-8971-4117-8fbb-73ae91e99647-kube-api-access-hbzmg\") pod \"db7d09c2-8971-4117-8fbb-73ae91e99647\" (UID: \"db7d09c2-8971-4117-8fbb-73ae91e99647\") "
Jul 08 21:41:29.123396 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123189    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-model-cache" (OuterVolumeSpecName: "model-cache") pod "db7d09c2-8971-4117-8fbb-73ae91e99647" (UID: "db7d09c2-8971-4117-8fbb-73ae91e99647"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:29.123396 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123197    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-home" (OuterVolumeSpecName: "home") pod "db7d09c2-8971-4117-8fbb-73ae91e99647" (UID: "db7d09c2-8971-4117-8fbb-73ae91e99647"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:29.123496 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123429    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:29.123496 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123425    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db7d09c2-8971-4117-8fbb-73ae91e99647" (UID: "db7d09c2-8971-4117-8fbb-73ae91e99647"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:29.123496 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.123449    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:29.125306 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.125275    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-dshm" (OuterVolumeSpecName: "dshm") pod "db7d09c2-8971-4117-8fbb-73ae91e99647" (UID: "db7d09c2-8971-4117-8fbb-73ae91e99647"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:29.125442 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.125348    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db7d09c2-8971-4117-8fbb-73ae91e99647-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db7d09c2-8971-4117-8fbb-73ae91e99647" (UID: "db7d09c2-8971-4117-8fbb-73ae91e99647"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:41:29.125442 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.125393    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db7d09c2-8971-4117-8fbb-73ae91e99647-kube-api-access-hbzmg" (OuterVolumeSpecName: "kube-api-access-hbzmg") pod "db7d09c2-8971-4117-8fbb-73ae91e99647" (UID: "db7d09c2-8971-4117-8fbb-73ae91e99647"). InnerVolumeSpecName "kube-api-access-hbzmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:29.158735 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.158698    2560 generic.go:356] "Generic (PLEG): container finished" podID="db7d09c2-8971-4117-8fbb-73ae91e99647" containerID="e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa" exitCode=0
Jul 08 21:41:29.158887 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.158739    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"
Jul 08 21:41:29.158887 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.158741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c" event={"ID":"db7d09c2-8971-4117-8fbb-73ae91e99647","Type":"ContainerDied","Data":"e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa"}
Jul 08 21:41:29.158887 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.158832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c" event={"ID":"db7d09c2-8971-4117-8fbb-73ae91e99647","Type":"ContainerDied","Data":"5e4d43095dbd0031755a2e7b07abcade539defd3e78940acdbe149b110b806bb"}
Jul 08 21:41:29.158887 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.158854    2560 scope.go:117] "RemoveContainer" containerID="e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa"
Jul 08 21:41:29.168194 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.168176    2560 scope.go:117] "RemoveContainer" containerID="e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa"
Jul 08 21:41:29.168519 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:41:29.168495    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa\": container with ID starting with e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa not found: ID does not exist" containerID="e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa"
Jul 08 21:41:29.168581 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.168527    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa"} err="failed to get container status \"e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa\": rpc error: code = NotFound desc = could not find container \"e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa\": container with ID starting with e29fdc3a8d718ed24092f3faca9f537d1401e0c56c4ea8b45b19617c0bf4aafa not found: ID does not exist"
Jul 08 21:41:29.179562 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.179540    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"]
Jul 08 21:41:29.181228 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.181208    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a8920c/test-model-a8920c-kserve-7574c4487-xcw5c"]
Jul 08 21:41:29.224123 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.224096    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db7d09c2-8971-4117-8fbb-73ae91e99647-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:29.224123 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.224118    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:29.224123 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.224127    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbzmg\" (UniqueName: \"kubernetes.io/projected/db7d09c2-8971-4117-8fbb-73ae91e99647-kube-api-access-hbzmg\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:29.224296 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.224135    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db7d09c2-8971-4117-8fbb-73ae91e99647-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:29.672267 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.672203    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s" podUID="e3196f4a-eb15-44b7-abc8-dc44e6bd5488" containerName="main" containerID="cri-o://523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547" gracePeriod=45
Jul 08 21:41:29.919359 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:29.919335    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:41:30.031182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031071    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tmp-dir\") pod \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") "
Jul 08 21:41:30.031182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031131    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-home\") pod \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") "
Jul 08 21:41:30.031182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-model-cache\") pod \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") "
Jul 08 21:41:30.031490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031205    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-dshm\") pod \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") "
Jul 08 21:41:30.031490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031235    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tls-certs\") pod \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") "
Jul 08 21:41:30.031490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031283    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8b5x\" (UniqueName: \"kubernetes.io/projected/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-kube-api-access-b8b5x\") pod \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\" (UID: \"e3196f4a-eb15-44b7-abc8-dc44e6bd5488\") "
Jul 08 21:41:30.031490 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031390    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e3196f4a-eb15-44b7-abc8-dc44e6bd5488" (UID: "e3196f4a-eb15-44b7-abc8-dc44e6bd5488"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:30.031645 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031496    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-model-cache" (OuterVolumeSpecName: "model-cache") pod "e3196f4a-eb15-44b7-abc8-dc44e6bd5488" (UID: "e3196f4a-eb15-44b7-abc8-dc44e6bd5488"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:30.031645 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031511    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-home" (OuterVolumeSpecName: "home") pod "e3196f4a-eb15-44b7-abc8-dc44e6bd5488" (UID: "e3196f4a-eb15-44b7-abc8-dc44e6bd5488"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:30.031645 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.031552    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.033513 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.033485    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-kube-api-access-b8b5x" (OuterVolumeSpecName: "kube-api-access-b8b5x") pod "e3196f4a-eb15-44b7-abc8-dc44e6bd5488" (UID: "e3196f4a-eb15-44b7-abc8-dc44e6bd5488"). InnerVolumeSpecName "kube-api-access-b8b5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:41:30.033513 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.033495    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-dshm" (OuterVolumeSpecName: "dshm") pod "e3196f4a-eb15-44b7-abc8-dc44e6bd5488" (UID: "e3196f4a-eb15-44b7-abc8-dc44e6bd5488"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:41:30.033634 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.033515    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e3196f4a-eb15-44b7-abc8-dc44e6bd5488" (UID: "e3196f4a-eb15-44b7-abc8-dc44e6bd5488"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:41:30.132414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.132381    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8b5x\" (UniqueName: \"kubernetes.io/projected/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-kube-api-access-b8b5x\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.132414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.132408    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.132414 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.132417    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.132634 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.132426    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.132634 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.132433    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3196f4a-eb15-44b7-abc8-dc44e6bd5488-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:41:30.165589 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.165552    2560 generic.go:356] "Generic (PLEG): container finished" podID="e3196f4a-eb15-44b7-abc8-dc44e6bd5488" containerID="523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547" exitCode=0
Jul 08 21:41:30.165739 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.165593    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"
Jul 08 21:41:30.165739 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.165603    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s" event={"ID":"e3196f4a-eb15-44b7-abc8-dc44e6bd5488","Type":"ContainerDied","Data":"523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547"}
Jul 08 21:41:30.165739 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.165633    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s" event={"ID":"e3196f4a-eb15-44b7-abc8-dc44e6bd5488","Type":"ContainerDied","Data":"3608c1b810c54ff7ca9e9fe3a9d23b6bef589a059084c0ee2a47fd674d4488d2"}
Jul 08 21:41:30.165739 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.165650    2560 scope.go:117] "RemoveContainer" containerID="523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547"
Jul 08 21:41:30.176789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.176522    2560 scope.go:117] "RemoveContainer" containerID="523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547"
Jul 08 21:41:30.176968 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:41:30.176947    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547\": container with ID starting with 523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547 not found: ID does not exist" containerID="523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547"
Jul 08 21:41:30.177027 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.176977    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547"} err="failed to get container status \"523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547\": rpc error: code = NotFound desc = could not find container \"523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547\": container with ID starting with 523d20236feaca9f21104edbe5381b266f4a4d1577fcaafc63593691a0855547 not found: ID does not exist"
Jul 08 21:41:30.186495 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.186468    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"]
Jul 08 21:41:30.189786 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.189765    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e687ba/test-model-e687ba-kserve-596d5d5555-9t99s"]
Jul 08 21:41:30.205526 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.205497    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db7d09c2-8971-4117-8fbb-73ae91e99647" path="/var/lib/kubelet/pods/db7d09c2-8971-4117-8fbb-73ae91e99647/volumes"
Jul 08 21:41:30.205895 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:41:30.205883    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3196f4a-eb15-44b7-abc8-dc44e6bd5488" path="/var/lib/kubelet/pods/e3196f4a-eb15-44b7-abc8-dc44e6bd5488/volumes"
Jul 08 21:42:01.287500 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:42:01.287418    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:42:15.890049 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:42:15.890016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:42:30.384542 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:42:30.384510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:42:40.380290 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:42:40.380259    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:42:52.094209 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:42:52.094169    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:43:04.191590 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:04.191553    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:43:16.530417 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530382    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"]
Jul 08 21:43:16.530984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530821    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db7d09c2-8971-4117-8fbb-73ae91e99647" containerName="main"
Jul 08 21:43:16.530984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530840    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="db7d09c2-8971-4117-8fbb-73ae91e99647" containerName="main"
Jul 08 21:43:16.530984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530855    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3196f4a-eb15-44b7-abc8-dc44e6bd5488" containerName="main"
Jul 08 21:43:16.530984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530864    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3196f4a-eb15-44b7-abc8-dc44e6bd5488" containerName="main"
Jul 08 21:43:16.530984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530957    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="db7d09c2-8971-4117-8fbb-73ae91e99647" containerName="main"
Jul 08 21:43:16.530984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.530968    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3196f4a-eb15-44b7-abc8-dc44e6bd5488" containerName="main"
Jul 08 21:43:16.534068 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.534048    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.536773 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.536755    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fbb91c\"/\"kube-root-ca.crt\""
Jul 08 21:43:16.537783 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.537764    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fbb91c\"/\"default-dockercfg-27dv2\""
Jul 08 21:43:16.537876 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.537845    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fbb91c\"/\"auth-test-model-fbb91c-kserve-self-signed-certs\""
Jul 08 21:43:16.537876 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.537860    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fbb91c\"/\"openshift-service-ca.crt\""
Jul 08 21:43:16.542486 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.542464    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"]
Jul 08 21:43:16.621317 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.621283    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-model-cache\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.621487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.621330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-home\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.621487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.621432    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tmp-dir\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.621487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.621467    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tls-certs\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.621612 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.621537    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbr2d\" (UniqueName: \"kubernetes.io/projected/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-kube-api-access-fbr2d\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.621612 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.621583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-dshm\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.722592 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.722558    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-home\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.722755 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.722610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tmp-dir\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.722755 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.722642    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tls-certs\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.722755 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.722688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbr2d\" (UniqueName: \"kubernetes.io/projected/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-kube-api-access-fbr2d\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.722755 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.722737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-dshm\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.722932 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.722769    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-model-cache\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.723079 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.723048    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-home\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.723155 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.723087    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tmp-dir\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.723155 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.723120    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-model-cache\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.724933 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.724910    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-dshm\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.725200 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.725185    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tls-certs\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.730831 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.730804    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbr2d\" (UniqueName: \"kubernetes.io/projected/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-kube-api-access-fbr2d\") pod \"auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") " pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.844159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.844124    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:16.976344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:16.976314    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"]
Jul 08 21:43:16.978242 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:43:16.978213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57d6017d_d0de_4ef6_a61d_f2efe021cc4f.slice/crio-f5c1e7a4456ff806de743929efb1d180ab5aac6f3cdc574f7c531903a74b5413 WatchSource:0}: Error finding container f5c1e7a4456ff806de743929efb1d180ab5aac6f3cdc574f7c531903a74b5413: Status 404 returned error can't find the container with id f5c1e7a4456ff806de743929efb1d180ab5aac6f3cdc574f7c531903a74b5413
Jul 08 21:43:17.639408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:17.639351    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc" event={"ID":"57d6017d-d0de-4ef6-a61d-f2efe021cc4f","Type":"ContainerStarted","Data":"bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314"}
Jul 08 21:43:17.639408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:17.639411    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc" event={"ID":"57d6017d-d0de-4ef6-a61d-f2efe021cc4f","Type":"ContainerStarted","Data":"f5c1e7a4456ff806de743929efb1d180ab5aac6f3cdc574f7c531903a74b5413"}
Jul 08 21:43:17.655014 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:17.654962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc" podStartSLOduration=1.6549466769999999 podStartE2EDuration="1.654946677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:43:17.654848891 +0000 UTC m=+2235.906771095" watchObservedRunningTime="2026-07-08 21:43:17.654946677 +0000 UTC m=+2235.906868869"
Jul 08 21:43:19.783422 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:19.783383    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:43:26.845006 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:26.844917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:26.845006 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:26.844981    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:26.857301 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:26.857277    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:27.694978 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:27.694948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:43:42.010716 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.010680    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"]
Jul 08 21:43:42.013735 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.013716    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.016244 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.016222    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"kube-root-ca.crt\""
Jul 08 21:43:42.017437 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.017413    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"auth-test-model-6edaf8-kserve-self-signed-certs\""
Jul 08 21:43:42.017596 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.017437    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"default-dockercfg-7pljg\""
Jul 08 21:43:42.017596 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.017495    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"openshift-service-ca.crt\""
Jul 08 21:43:42.023230 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.023208    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"]
Jul 08 21:43:42.146519 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.146480    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-home\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.146708 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.146532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwb2w\" (UniqueName: \"kubernetes.io/projected/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-kube-api-access-xwb2w\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.146708 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.146560    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tls-certs\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.146708 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.146631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-dshm\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.146708 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.146673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-model-cache\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.146859 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.146706    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tmp-dir\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.247984 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.247953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-model-cache\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.247999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tmp-dir\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-home\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248067    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwb2w\" (UniqueName: \"kubernetes.io/projected/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-kube-api-access-xwb2w\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tls-certs\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248159 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-dshm\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248468 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248448    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tmp-dir\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248536 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248447    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-model-cache\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.248592 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.248541    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-home\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.250376 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.250341    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-dshm\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.250628 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.250610    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tls-certs\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.255836 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.255816    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwb2w\" (UniqueName: \"kubernetes.io/projected/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-kube-api-access-xwb2w\") pod \"auth-test-model-6edaf8-kserve-bd585b875-chl5t\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") " pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.324571 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.324486    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:42.462716 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.460095    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"]
Jul 08 21:43:42.466053 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:43:42.466014    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddcd3fa3_aacf_46e5_b5ac_0dfd64892f78.slice/crio-075afad0bbebf539aa4636b7ef32037d88d9a6f136d2efd0d15e21b68ac7facc WatchSource:0}: Error finding container 075afad0bbebf539aa4636b7ef32037d88d9a6f136d2efd0d15e21b68ac7facc: Status 404 returned error can't find the container with id 075afad0bbebf539aa4636b7ef32037d88d9a6f136d2efd0d15e21b68ac7facc
Jul 08 21:43:42.752390 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.752343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t" event={"ID":"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78","Type":"ContainerStarted","Data":"0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705"}
Jul 08 21:43:42.752585 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.752401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t" event={"ID":"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78","Type":"ContainerStarted","Data":"075afad0bbebf539aa4636b7ef32037d88d9a6f136d2efd0d15e21b68ac7facc"}
Jul 08 21:43:42.769103 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:42.769047    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t" podStartSLOduration=1.769033399 podStartE2EDuration="1.769033399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:43:42.767934337 +0000 UTC m=+2261.019856534" watchObservedRunningTime="2026-07-08 21:43:42.769033399 +0000 UTC m=+2261.020955602"
Jul 08 21:43:45.488288 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:45.488251    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:43:52.324878 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:52.324842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:52.324878 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:52.324889    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:52.337280 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:52.337255    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:43:52.807838 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:43:52.807812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:44:10.581423 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:44:10.581383    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:44:24.393002 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:44:24.392962    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:44:39.480726 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:44:39.480685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:44:58.081009 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:44:58.080911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:45:14.483793 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:14.483756    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:45:30.985929 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:30.985889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:45:44.831752 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:44.831712    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"]
Jul 08 21:45:45.705510 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:45.705477    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"]
Jul 08 21:45:49.080551 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:49.080518    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:45:52.828529 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.828490    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"]
Jul 08 21:45:52.832312 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.832290    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:52.834657 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.834635    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fbb91c\"/\"sub-test-model-fbb91c-kserve-self-signed-certs\""
Jul 08 21:45:52.840144 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.839705    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"]
Jul 08 21:45:52.939196 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.939154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-home\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:52.939411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.939216    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tls-certs\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:52.939411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.939265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrh2b\" (UniqueName: \"kubernetes.io/projected/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-kube-api-access-zrh2b\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:52.939411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.939297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tmp-dir\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:52.939411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.939340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-dshm\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:52.939411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:52.939359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-model-cache\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tls-certs\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040189 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040195    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrh2b\" (UniqueName: \"kubernetes.io/projected/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-kube-api-access-zrh2b\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040456 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tmp-dir\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040456 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-dshm\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040456 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-model-cache\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040456 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-home\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040798 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040776    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-home\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040858 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040802    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tmp-dir\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.040913 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.040853    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-model-cache\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.042646 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.042623    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-dshm\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.042787 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.042772    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tls-certs\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.048627 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.048597    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrh2b\" (UniqueName: \"kubernetes.io/projected/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-kube-api-access-zrh2b\") pod \"sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") " pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.143712 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.143672    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:45:53.276534 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.276509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"]
Jul 08 21:45:53.278770 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:45:53.278744    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cd3bcb7_39c0_4e0d_ae21_e12945dc7186.slice/crio-08121ee1830b661f076bdb00ecaa2660541006f6f3c79422aa566dfe24713767 WatchSource:0}: Error finding container 08121ee1830b661f076bdb00ecaa2660541006f6f3c79422aa566dfe24713767: Status 404 returned error can't find the container with id 08121ee1830b661f076bdb00ecaa2660541006f6f3c79422aa566dfe24713767
Jul 08 21:45:53.342998 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.342969    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q" event={"ID":"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186","Type":"ContainerStarted","Data":"defe8d9bfcb269dfed87d36caf97142b28487fea124459ca1b05f7e7fecf0a0d"}
Jul 08 21:45:53.343126 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.343010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q" event={"ID":"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186","Type":"ContainerStarted","Data":"08121ee1830b661f076bdb00ecaa2660541006f6f3c79422aa566dfe24713767"}
Jul 08 21:45:53.360746 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:53.360698    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q" podStartSLOduration=1.360683477 podStartE2EDuration="1.360683477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:45:53.358964689 +0000 UTC m=+2391.610886900" watchObservedRunningTime="2026-07-08 21:45:53.360683477 +0000 UTC m=+2391.612605678"
Jul 08 21:45:59.852150 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:45:59.852101    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc" podUID="57d6017d-d0de-4ef6-a61d-f2efe021cc4f" containerName="main" containerID="cri-o://bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314" gracePeriod=45
Jul 08 21:46:00.110747 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.110681    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:46:00.200101 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200058    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-home\") pod \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") "
Jul 08 21:46:00.200298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200151    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-dshm\") pod \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") "
Jul 08 21:46:00.200298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200177    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-model-cache\") pod \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") "
Jul 08 21:46:00.200298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200228    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tmp-dir\") pod \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") "
Jul 08 21:46:00.200298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tls-certs\") pod \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") "
Jul 08 21:46:00.200539 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200302    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbr2d\" (UniqueName: \"kubernetes.io/projected/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-kube-api-access-fbr2d\") pod \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\" (UID: \"57d6017d-d0de-4ef6-a61d-f2efe021cc4f\") "
Jul 08 21:46:00.200539 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200433    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-home" (OuterVolumeSpecName: "home") pod "57d6017d-d0de-4ef6-a61d-f2efe021cc4f" (UID: "57d6017d-d0de-4ef6-a61d-f2efe021cc4f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:00.200623 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200534    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-model-cache" (OuterVolumeSpecName: "model-cache") pod "57d6017d-d0de-4ef6-a61d-f2efe021cc4f" (UID: "57d6017d-d0de-4ef6-a61d-f2efe021cc4f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:00.200623 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200568    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57d6017d-d0de-4ef6-a61d-f2efe021cc4f" (UID: "57d6017d-d0de-4ef6-a61d-f2efe021cc4f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:00.200937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200884    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:00.200937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200911    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:00.200937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.200926    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:00.202541 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.202503    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57d6017d-d0de-4ef6-a61d-f2efe021cc4f" (UID: "57d6017d-d0de-4ef6-a61d-f2efe021cc4f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:46:00.202642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.202554    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-dshm" (OuterVolumeSpecName: "dshm") pod "57d6017d-d0de-4ef6-a61d-f2efe021cc4f" (UID: "57d6017d-d0de-4ef6-a61d-f2efe021cc4f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:00.202642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.202580    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-kube-api-access-fbr2d" (OuterVolumeSpecName: "kube-api-access-fbr2d") pod "57d6017d-d0de-4ef6-a61d-f2efe021cc4f" (UID: "57d6017d-d0de-4ef6-a61d-f2efe021cc4f"). InnerVolumeSpecName "kube-api-access-fbr2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:46:00.302300 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.302263    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:00.302300 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.302294    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:00.302300 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.302304    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbr2d\" (UniqueName: \"kubernetes.io/projected/57d6017d-d0de-4ef6-a61d-f2efe021cc4f-kube-api-access-fbr2d\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:00.379147 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.379067    2560 generic.go:356] "Generic (PLEG): container finished" podID="57d6017d-d0de-4ef6-a61d-f2efe021cc4f" containerID="bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314" exitCode=0
Jul 08 21:46:00.379147 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.379104    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"
Jul 08 21:46:00.379327 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.379146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc" event={"ID":"57d6017d-d0de-4ef6-a61d-f2efe021cc4f","Type":"ContainerDied","Data":"bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314"}
Jul 08 21:46:00.379327 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.379190    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc" event={"ID":"57d6017d-d0de-4ef6-a61d-f2efe021cc4f","Type":"ContainerDied","Data":"f5c1e7a4456ff806de743929efb1d180ab5aac6f3cdc574f7c531903a74b5413"}
Jul 08 21:46:00.379327 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.379206    2560 scope.go:117] "RemoveContainer" containerID="bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314"
Jul 08 21:46:00.387185 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.387169    2560 scope.go:117] "RemoveContainer" containerID="bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314"
Jul 08 21:46:00.387516 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:46:00.387483    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314\": container with ID starting with bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314 not found: ID does not exist" containerID="bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314"
Jul 08 21:46:00.387630 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.387522    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314"} err="failed to get container status \"bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314\": rpc error: code = NotFound desc = could not find container \"bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314\": container with ID starting with bb464b76dd48e90caeb4f64735b3fb59dadb0f693822e436c5ac21a6ddc71314 not found: ID does not exist"
Jul 08 21:46:00.394541 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.394512    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"]
Jul 08 21:46:00.398290 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.398272    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/auth-test-model-fbb91c-kserve-86c5bdb7dc-dz4pc"]
Jul 08 21:46:00.726097 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.725996    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t" podUID="ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" containerName="main" containerID="cri-o://0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705" gracePeriod=45
Jul 08 21:46:00.973964 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:00.973940    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:46:01.107817 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.107788    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-dshm\") pod \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") "
Jul 08 21:46:01.108012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.107828    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tls-certs\") pod \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") "
Jul 08 21:46:01.108012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.107876    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-home\") pod \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") "
Jul 08 21:46:01.108012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.107899    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwb2w\" (UniqueName: \"kubernetes.io/projected/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-kube-api-access-xwb2w\") pod \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") "
Jul 08 21:46:01.108012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.107943    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-model-cache\") pod \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") "
Jul 08 21:46:01.108012 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.107971    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tmp-dir\") pod \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\" (UID: \"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78\") "
Jul 08 21:46:01.108408 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.108380    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-home" (OuterVolumeSpecName: "home") pod "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" (UID: "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:01.108548 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.108396    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-model-cache" (OuterVolumeSpecName: "model-cache") pod "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" (UID: "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:01.108548 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.108493    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" (UID: "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:01.110087 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.110064    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-dshm" (OuterVolumeSpecName: "dshm") pod "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" (UID: "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:46:01.110185 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.110170    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-kube-api-access-xwb2w" (OuterVolumeSpecName: "kube-api-access-xwb2w") pod "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" (UID: "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78"). InnerVolumeSpecName "kube-api-access-xwb2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:46:01.110226 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.110196    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" (UID: "ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:46:01.209486 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.209450    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:01.209486 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.209482    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwb2w\" (UniqueName: \"kubernetes.io/projected/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-kube-api-access-xwb2w\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:01.209486 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.209493    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:01.209707 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.209504    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:01.209707 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.209513    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:01.209707 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.209520    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:46:01.385242 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.385158    2560 generic.go:356] "Generic (PLEG): container finished" podID="ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" containerID="0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705" exitCode=0
Jul 08 21:46:01.385242 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.385195    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"
Jul 08 21:46:01.385483 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.385243    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t" event={"ID":"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78","Type":"ContainerDied","Data":"0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705"}
Jul 08 21:46:01.385483 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.385282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t" event={"ID":"ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78","Type":"ContainerDied","Data":"075afad0bbebf539aa4636b7ef32037d88d9a6f136d2efd0d15e21b68ac7facc"}
Jul 08 21:46:01.385483 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.385305    2560 scope.go:117] "RemoveContainer" containerID="0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705"
Jul 08 21:46:01.394339 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.394319    2560 scope.go:117] "RemoveContainer" containerID="0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705"
Jul 08 21:46:01.394597 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:46:01.394579    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705\": container with ID starting with 0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705 not found: ID does not exist" containerID="0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705"
Jul 08 21:46:01.394654 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.394603    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705"} err="failed to get container status \"0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705\": rpc error: code = NotFound desc = could not find container \"0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705\": container with ID starting with 0b594d14577e17752ad051cfc46186647fe51642cb313122788d0a2af0b7b705 not found: ID does not exist"
Jul 08 21:46:01.409921 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.407774    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"]
Jul 08 21:46:01.413036 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:01.413009    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/auth-test-model-6edaf8-kserve-bd585b875-chl5t"]
Jul 08 21:46:02.205328 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:02.205291    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57d6017d-d0de-4ef6-a61d-f2efe021cc4f" path="/var/lib/kubelet/pods/57d6017d-d0de-4ef6-a61d-f2efe021cc4f/volumes"
Jul 08 21:46:02.205871 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:02.205851    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" path="/var/lib/kubelet/pods/ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78/volumes"
Jul 08 21:46:03.144048 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:03.144014    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:46:03.144253 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:03.144070    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:46:03.156844 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:03.156819    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:46:03.406530 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:03.406442    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:46:04.580704 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:46:04.580672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:47:01.929505 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929470    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"]
Jul 08 21:47:01.929937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929769    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d6017d-d0de-4ef6-a61d-f2efe021cc4f" containerName="main"
Jul 08 21:47:01.929937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929780    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d6017d-d0de-4ef6-a61d-f2efe021cc4f" containerName="main"
Jul 08 21:47:01.929937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929793    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" containerName="main"
Jul 08 21:47:01.929937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929798    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" containerName="main"
Jul 08 21:47:01.929937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929859    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d6017d-d0de-4ef6-a61d-f2efe021cc4f" containerName="main"
Jul 08 21:47:01.929937 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.929867    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddcd3fa3-aacf-46e5-b5ac-0dfd64892f78" containerName="main"
Jul 08 21:47:01.932622 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.932607    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:01.936024 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.936004    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"default-dockercfg-7pljg\""
Jul 08 21:47:01.936163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.936005    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"sub-test-model-6edaf8-kserve-self-signed-certs\""
Jul 08 21:47:01.936163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.936006    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"kube-root-ca.crt\""
Jul 08 21:47:01.936163 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.936053    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"openshift-service-ca.crt\""
Jul 08 21:47:01.942032 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:01.942007    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"]
Jul 08 21:47:02.018116 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.018081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-home\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.018328 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.018138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-dshm\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.018328 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.018167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-model-cache\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.018328 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.018242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tmp-dir\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.018328 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.018286    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv726\" (UniqueName: \"kubernetes.io/projected/018bc8a0-06a5-4b58-a58e-9f7c004b5177-kube-api-access-qv726\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.018328 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.018312    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tls-certs\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.118972 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.118937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-home\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.118986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-dshm\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119016    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-model-cache\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tmp-dir\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv726\" (UniqueName: \"kubernetes.io/projected/018bc8a0-06a5-4b58-a58e-9f7c004b5177-kube-api-access-qv726\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119133 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119085    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tls-certs\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119402    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-home\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119471 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119443    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-model-cache\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.119555 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.119479    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tmp-dir\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.121259 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.121232    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-dshm\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.121802 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.121784    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"sub-test-model-6edaf8-kserve-self-signed-certs\""
Jul 08 21:47:02.128204 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.128186    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"kube-root-ca.crt\""
Jul 08 21:47:02.131468 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.131444    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tls-certs\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.138979 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.138959    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"openshift-service-ca.crt\""
Jul 08 21:47:02.148695 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.148663    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv726\" (UniqueName: \"kubernetes.io/projected/018bc8a0-06a5-4b58-a58e-9f7c004b5177-kube-api-access-qv726\") pod \"sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") " pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.245149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.245073    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"default-dockercfg-7pljg\""
Jul 08 21:47:02.253099 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.253079    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:02.390774 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.390753    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"]
Jul 08 21:47:02.392704 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:47:02.392681    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod018bc8a0_06a5_4b58_a58e_9f7c004b5177.slice/crio-d7398fdb01eaa6ea4cfab662211babead641c22b26c0ab8b9cd6f3bd3c2b5ea7 WatchSource:0}: Error finding container d7398fdb01eaa6ea4cfab662211babead641c22b26c0ab8b9cd6f3bd3c2b5ea7: Status 404 returned error can't find the container with id d7398fdb01eaa6ea4cfab662211babead641c22b26c0ab8b9cd6f3bd3c2b5ea7
Jul 08 21:47:02.656676 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.656644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8" event={"ID":"018bc8a0-06a5-4b58-a58e-9f7c004b5177","Type":"ContainerStarted","Data":"ff274732e7d7b08c9445461046f80c194d48121ba8363bbd650fea0747a591b2"}
Jul 08 21:47:02.656868 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.656685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8" event={"ID":"018bc8a0-06a5-4b58-a58e-9f7c004b5177","Type":"ContainerStarted","Data":"d7398fdb01eaa6ea4cfab662211babead641c22b26c0ab8b9cd6f3bd3c2b5ea7"}
Jul 08 21:47:02.673642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:02.673588    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8" podStartSLOduration=1.67357018 podStartE2EDuration="1.67357018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:47:02.671884328 +0000 UTC m=+2460.923806531" watchObservedRunningTime="2026-07-08 21:47:02.67357018 +0000 UTC m=+2460.925492381"
Jul 08 21:47:06.680249 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:06.680215    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:47:12.254258 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:12.254221    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:12.254258 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:12.254264    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:12.266475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:12.266450    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:12.711511 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:12.711481    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:47:27.985494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:27.985458    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:47:46.483846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:46.483813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:47:53.767000 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:53.766964    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"]
Jul 08 21:47:54.705593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:47:54.705558    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"]
Jul 08 21:48:01.332913 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.332875    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"]
Jul 08 21:48:01.336084 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.336068    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.338825 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.338797    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fbb91c\"/\"rate-test-model-fbb91c-kserve-self-signed-certs\""
Jul 08 21:48:01.345890 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.345867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"]
Jul 08 21:48:01.429007 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.428969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-model-cache\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.429182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.429032    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tmp-dir\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.429182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.429092    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq5lz\" (UniqueName: \"kubernetes.io/projected/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-kube-api-access-pq5lz\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.429182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.429128    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-home\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.429182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.429148    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-dshm\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.429182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.429168    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tls-certs\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.530675 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.530638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-model-cache\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.530848 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.530712    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tmp-dir\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.530848 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.530749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq5lz\" (UniqueName: \"kubernetes.io/projected/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-kube-api-access-pq5lz\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.530848 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.530782    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-home\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.530848 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.530806    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-dshm\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.530848 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.530832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tls-certs\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.531149 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.531127    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-model-cache\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.531196 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.531172    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tmp-dir\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.531233 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.531187    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-home\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.533134 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.533108    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-dshm\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.533308 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.533290    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tls-certs\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.537960 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.537942    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq5lz\" (UniqueName: \"kubernetes.io/projected/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-kube-api-access-pq5lz\") pod \"rate-test-model-fbb91c-kserve-644d487d47-hng9h\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") " pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.645541 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.645501    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:01.776846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.776822    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"]
Jul 08 21:48:01.778852 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:48:01.778826    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bf33b8c_483c_45a5_9ad1_09f813ab34f3.slice/crio-fb736fcdc6e6cd8ad1e77317e0a777cd8d7495f74e9bab65fdbf02816b1edc55 WatchSource:0}: Error finding container fb736fcdc6e6cd8ad1e77317e0a777cd8d7495f74e9bab65fdbf02816b1edc55: Status 404 returned error can't find the container with id fb736fcdc6e6cd8ad1e77317e0a777cd8d7495f74e9bab65fdbf02816b1edc55
Jul 08 21:48:01.928545 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.928457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h" event={"ID":"3bf33b8c-483c-45a5-9ad1-09f813ab34f3","Type":"ContainerStarted","Data":"30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87"}
Jul 08 21:48:01.928545 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.928500    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h" event={"ID":"3bf33b8c-483c-45a5-9ad1-09f813ab34f3","Type":"ContainerStarted","Data":"fb736fcdc6e6cd8ad1e77317e0a777cd8d7495f74e9bab65fdbf02816b1edc55"}
Jul 08 21:48:01.944287 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:01.944241    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h" podStartSLOduration=0.944226748 podStartE2EDuration="944.226748ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:48:01.943429083 +0000 UTC m=+2520.195351287" watchObservedRunningTime="2026-07-08 21:48:01.944226748 +0000 UTC m=+2520.196148969"
Jul 08 21:48:07.183265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:07.183224    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:48:08.788701 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:08.788661    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q" podUID="0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" containerName="main" containerID="cri-o://defe8d9bfcb269dfed87d36caf97142b28487fea124459ca1b05f7e7fecf0a0d" gracePeriod=45
Jul 08 21:48:08.963636 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:08.963600    2560 generic.go:356] "Generic (PLEG): container finished" podID="0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" containerID="defe8d9bfcb269dfed87d36caf97142b28487fea124459ca1b05f7e7fecf0a0d" exitCode=0
Jul 08 21:48:08.963773 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:08.963632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q" event={"ID":"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186","Type":"ContainerDied","Data":"defe8d9bfcb269dfed87d36caf97142b28487fea124459ca1b05f7e7fecf0a0d"}
Jul 08 21:48:09.042715 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.042651    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:48:09.205676 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.205644    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-dshm\") pod \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") "
Jul 08 21:48:09.205867 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.205706    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tls-certs\") pod \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") "
Jul 08 21:48:09.205867 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.205744    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-model-cache\") pod \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") "
Jul 08 21:48:09.205867 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.205766    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tmp-dir\") pod \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") "
Jul 08 21:48:09.205867 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.205822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-home\") pod \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") "
Jul 08 21:48:09.205867 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.205840    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrh2b\" (UniqueName: \"kubernetes.io/projected/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-kube-api-access-zrh2b\") pod \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\" (UID: \"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186\") "
Jul 08 21:48:09.206131 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.206063    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-model-cache" (OuterVolumeSpecName: "model-cache") pod "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" (UID: "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:09.206131 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.206088    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" (UID: "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:09.206207 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.206140    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-home" (OuterVolumeSpecName: "home") pod "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" (UID: "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:09.207894 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.207871    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" (UID: "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:48:09.208003 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.207911    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-dshm" (OuterVolumeSpecName: "dshm") pod "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" (UID: "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:09.208003 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.207914    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-kube-api-access-zrh2b" (OuterVolumeSpecName: "kube-api-access-zrh2b") pod "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" (UID: "0cd3bcb7-39c0-4e0d-ae21-e12945dc7186"). InnerVolumeSpecName "kube-api-access-zrh2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:48:09.307386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.307284    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:09.307386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.307315    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:09.307386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.307324    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:09.307386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.307334    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrh2b\" (UniqueName: \"kubernetes.io/projected/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-kube-api-access-zrh2b\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:09.307386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.307343    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:09.307386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.307352    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:09.725988 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.725941    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8" podUID="018bc8a0-06a5-4b58-a58e-9f7c004b5177" containerName="main" containerID="cri-o://ff274732e7d7b08c9445461046f80c194d48121ba8363bbd650fea0747a591b2" gracePeriod=45
Jul 08 21:48:09.970697 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.970664    2560 generic.go:356] "Generic (PLEG): container finished" podID="018bc8a0-06a5-4b58-a58e-9f7c004b5177" containerID="ff274732e7d7b08c9445461046f80c194d48121ba8363bbd650fea0747a591b2" exitCode=0
Jul 08 21:48:09.971067 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.970738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8" event={"ID":"018bc8a0-06a5-4b58-a58e-9f7c004b5177","Type":"ContainerDied","Data":"ff274732e7d7b08c9445461046f80c194d48121ba8363bbd650fea0747a591b2"}
Jul 08 21:48:09.971067 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.970792    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8" event={"ID":"018bc8a0-06a5-4b58-a58e-9f7c004b5177","Type":"ContainerDied","Data":"d7398fdb01eaa6ea4cfab662211babead641c22b26c0ab8b9cd6f3bd3c2b5ea7"}
Jul 08 21:48:09.971067 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.970809    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7398fdb01eaa6ea4cfab662211babead641c22b26c0ab8b9cd6f3bd3c2b5ea7"
Jul 08 21:48:09.972281 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.972251    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q" event={"ID":"0cd3bcb7-39c0-4e0d-ae21-e12945dc7186","Type":"ContainerDied","Data":"08121ee1830b661f076bdb00ecaa2660541006f6f3c79422aa566dfe24713767"}
Jul 08 21:48:09.972417 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.972282    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"
Jul 08 21:48:09.972417 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.972299    2560 scope.go:117] "RemoveContainer" containerID="defe8d9bfcb269dfed87d36caf97142b28487fea124459ca1b05f7e7fecf0a0d"
Jul 08 21:48:09.978174 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:09.978119    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:48:10.005223 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.005181    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"]
Jul 08 21:48:10.008601 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.008574    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/sub-test-model-fbb91c-kserve-7bf8dc5dc7-8xv2q"]
Jul 08 21:48:10.115334 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115286    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv726\" (UniqueName: \"kubernetes.io/projected/018bc8a0-06a5-4b58-a58e-9f7c004b5177-kube-api-access-qv726\") pod \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") "
Jul 08 21:48:10.115334 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115351    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tmp-dir\") pod \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") "
Jul 08 21:48:10.115593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115419    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-model-cache\") pod \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") "
Jul 08 21:48:10.115593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115461    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-dshm\") pod \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") "
Jul 08 21:48:10.115593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tls-certs\") pod \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") "
Jul 08 21:48:10.115593 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115521    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-home\") pod \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\" (UID: \"018bc8a0-06a5-4b58-a58e-9f7c004b5177\") "
Jul 08 21:48:10.115808 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115692    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-model-cache" (OuterVolumeSpecName: "model-cache") pod "018bc8a0-06a5-4b58-a58e-9f7c004b5177" (UID: "018bc8a0-06a5-4b58-a58e-9f7c004b5177"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:10.115808 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115704    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "018bc8a0-06a5-4b58-a58e-9f7c004b5177" (UID: "018bc8a0-06a5-4b58-a58e-9f7c004b5177"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:10.115918 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115838    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-home" (OuterVolumeSpecName: "home") pod "018bc8a0-06a5-4b58-a58e-9f7c004b5177" (UID: "018bc8a0-06a5-4b58-a58e-9f7c004b5177"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:10.115918 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115875    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:10.115918 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.115888    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:10.117629 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.117602    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-dshm" (OuterVolumeSpecName: "dshm") pod "018bc8a0-06a5-4b58-a58e-9f7c004b5177" (UID: "018bc8a0-06a5-4b58-a58e-9f7c004b5177"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:48:10.117730 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.117641    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "018bc8a0-06a5-4b58-a58e-9f7c004b5177" (UID: "018bc8a0-06a5-4b58-a58e-9f7c004b5177"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:48:10.117730 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.117686    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018bc8a0-06a5-4b58-a58e-9f7c004b5177-kube-api-access-qv726" (OuterVolumeSpecName: "kube-api-access-qv726") pod "018bc8a0-06a5-4b58-a58e-9f7c004b5177" (UID: "018bc8a0-06a5-4b58-a58e-9f7c004b5177"). InnerVolumeSpecName "kube-api-access-qv726". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:48:10.210001 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.209968    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" path="/var/lib/kubelet/pods/0cd3bcb7-39c0-4e0d-ae21-e12945dc7186/volumes"
Jul 08 21:48:10.216423 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.216398    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:10.216557 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.216438    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/018bc8a0-06a5-4b58-a58e-9f7c004b5177-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:10.216557 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.216448    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/018bc8a0-06a5-4b58-a58e-9f7c004b5177-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:10.216557 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.216457    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv726\" (UniqueName: \"kubernetes.io/projected/018bc8a0-06a5-4b58-a58e-9f7c004b5177-kube-api-access-qv726\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:48:10.978033 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.978000    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"
Jul 08 21:48:10.993083 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.993034    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"]
Jul 08 21:48:10.995213 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:10.995192    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/sub-test-model-6edaf8-kserve-75bb8dc679-bnpk8"]
Jul 08 21:48:11.646426 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:11.646389    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:11.646426 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:11.646436    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:11.659093 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:11.659062    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:11.993877 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:11.993797    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:48:12.205075 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:12.205041    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018bc8a0-06a5-4b58-a58e-9f7c004b5177" path="/var/lib/kubelet/pods/018bc8a0-06a5-4b58-a58e-9f7c004b5177/volumes"
Jul 08 21:48:19.727868 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.727837    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"]
Jul 08 21:48:19.728269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.728139    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" containerName="main"
Jul 08 21:48:19.728269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.728149    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" containerName="main"
Jul 08 21:48:19.728269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.728167    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018bc8a0-06a5-4b58-a58e-9f7c004b5177" containerName="main"
Jul 08 21:48:19.728269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.728173    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="018bc8a0-06a5-4b58-a58e-9f7c004b5177" containerName="main"
Jul 08 21:48:19.728269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.728223    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="018bc8a0-06a5-4b58-a58e-9f7c004b5177" containerName="main"
Jul 08 21:48:19.728269 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.728230    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd3bcb7-39c0-4e0d-ae21-e12945dc7186" containerName="main"
Jul 08 21:48:19.732344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.732323    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.734678 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.734654    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"default-dockercfg-7pljg\""
Jul 08 21:48:19.734788 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.734696    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"openshift-service-ca.crt\""
Jul 08 21:48:19.735622 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.735602    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"kube-root-ca.crt\""
Jul 08 21:48:19.735710 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.735646    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6edaf8\"/\"rate-test-model-6edaf8-kserve-self-signed-certs\""
Jul 08 21:48:19.741585 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.741560    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"]
Jul 08 21:48:19.801528 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.801498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tmp-dir\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.801709 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.801543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tls-certs\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.801709 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.801629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-dshm\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.801709 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.801674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgdp2\" (UniqueName: \"kubernetes.io/projected/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-kube-api-access-hgdp2\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.801883 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.801716    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-model-cache\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.801883 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.801761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-home\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tmp-dir\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902563 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tls-certs\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902563 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902432    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-dshm\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902563 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgdp2\" (UniqueName: \"kubernetes.io/projected/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-kube-api-access-hgdp2\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902563 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-model-cache\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902563 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-home\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902859 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902838    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tmp-dir\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.902927 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902909    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-model-cache\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.903011 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.902990    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-home\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.904834 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.904804    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-dshm\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.904979 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.904963    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tls-certs\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:19.909755 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:19.909734    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgdp2\" (UniqueName: \"kubernetes.io/projected/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-kube-api-access-hgdp2\") pod \"rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") " pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:20.041113 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:20.041015    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:20.169850 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:20.169811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"]
Jul 08 21:48:20.172920 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:48:20.172886    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36d86f48_7e82_41a5_8e3e_5f7ec93f3a29.slice/crio-91dae30188d5f61f1bba525d4803d00bf1116364dc16691760c0237331404c5c WatchSource:0}: Error finding container 91dae30188d5f61f1bba525d4803d00bf1116364dc16691760c0237331404c5c: Status 404 returned error can't find the container with id 91dae30188d5f61f1bba525d4803d00bf1116364dc16691760c0237331404c5c
Jul 08 21:48:21.023766 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:21.023726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt" event={"ID":"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29","Type":"ContainerStarted","Data":"130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a"}
Jul 08 21:48:21.023766 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:21.023768    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt" event={"ID":"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29","Type":"ContainerStarted","Data":"91dae30188d5f61f1bba525d4803d00bf1116364dc16691760c0237331404c5c"}
Jul 08 21:48:21.041770 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:21.041718    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt" podStartSLOduration=2.041704189 podStartE2EDuration="2.041704189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:48:21.039775639 +0000 UTC m=+2539.291697833" watchObservedRunningTime="2026-07-08 21:48:21.041704189 +0000 UTC m=+2539.293626393"
Jul 08 21:48:24.688854 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:24.688811    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:48:30.041397 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:30.041338    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:30.041856 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:30.041409    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:30.054274 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:30.054246    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:30.076334 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:30.076306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:48:44.578239 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:44.578196    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:48:58.982495 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:48:58.982459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:49:13.376664 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:13.376629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:49:17.902805 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:17.902764    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"]
Jul 08 21:49:18.668693 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:18.668653    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"]
Jul 08 21:49:19.840178 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.840141    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191913418288"]
Jul 08 21:49:19.843559 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.843542    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:19.845876 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.845856    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 21:49:19.847058 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.847033    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 21:49:19.847197 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.847069    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-bthw5\""
Jul 08 21:49:19.849353 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.849319    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191913418288"]
Jul 08 21:49:19.915613 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:19.915577    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfptm\" (UniqueName: \"kubernetes.io/projected/0508a977-ea39-464c-9849-d051e7eb3b90-kube-api-access-sfptm\") pod \"test-curl-7802-140191913418288\" (UID: \"0508a977-ea39-464c-9849-d051e7eb3b90\") " pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:20.016312 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:20.016276    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfptm\" (UniqueName: \"kubernetes.io/projected/0508a977-ea39-464c-9849-d051e7eb3b90-kube-api-access-sfptm\") pod \"test-curl-7802-140191913418288\" (UID: \"0508a977-ea39-464c-9849-d051e7eb3b90\") " pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:20.024117 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:20.024086    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfptm\" (UniqueName: \"kubernetes.io/projected/0508a977-ea39-464c-9849-d051e7eb3b90-kube-api-access-sfptm\") pod \"test-curl-7802-140191913418288\" (UID: \"0508a977-ea39-464c-9849-d051e7eb3b90\") " pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:20.153517 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:20.153436    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:20.286202 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:20.286178    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191913418288"]
Jul 08 21:49:20.288318 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:49:20.288286    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0508a977_ea39_464c_9849_d051e7eb3b90.slice/crio-9ed211dfc72476efbdf2d0da177241da9e0d866352e27a199b024cbd71e8fe4b WatchSource:0}: Error finding container 9ed211dfc72476efbdf2d0da177241da9e0d866352e27a199b024cbd71e8fe4b: Status 404 returned error can't find the container with id 9ed211dfc72476efbdf2d0da177241da9e0d866352e27a199b024cbd71e8fe4b
Jul 08 21:49:20.289987 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:20.289969    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 21:49:20.295742 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:20.295715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288" event={"ID":"0508a977-ea39-464c-9849-d051e7eb3b90","Type":"ContainerStarted","Data":"9ed211dfc72476efbdf2d0da177241da9e0d866352e27a199b024cbd71e8fe4b"}
Jul 08 21:49:21.301681 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:21.301589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288" event={"ID":"0508a977-ea39-464c-9849-d051e7eb3b90","Type":"ContainerStarted","Data":"e0c2044bb77d003e3bf640e9c1293f49d865a515f6e2b11ca9b4e3548051240b"}
Jul 08 21:49:21.316965 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:21.316889    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288" podStartSLOduration=1.6537185239999999 podStartE2EDuration="2.316875377s" totalImagesPullingTime="663.156853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:49:21.315741768 +0000 UTC m=+2599.567663970" watchObservedRunningTime="2026-07-08 21:49:21.316875377 +0000 UTC m=+2599.568797582"
Jul 08 21:49:29.377733 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:29.377652    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:49:31.349084 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:31.349051    2560 generic.go:356] "Generic (PLEG): container finished" podID="0508a977-ea39-464c-9849-d051e7eb3b90" containerID="e0c2044bb77d003e3bf640e9c1293f49d865a515f6e2b11ca9b4e3548051240b" exitCode=28
Jul 08 21:49:31.349576 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:31.349132    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288" event={"ID":"0508a977-ea39-464c-9849-d051e7eb3b90","Type":"ContainerDied","Data":"e0c2044bb77d003e3bf640e9c1293f49d865a515f6e2b11ca9b4e3548051240b"}
Jul 08 21:49:32.485535 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.485510    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:32.517611 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.517570    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191913418288"]
Jul 08 21:49:32.519212 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.519191    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191913418288"]
Jul 08 21:49:32.622497 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.622412    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfptm\" (UniqueName: \"kubernetes.io/projected/0508a977-ea39-464c-9849-d051e7eb3b90-kube-api-access-sfptm\") pod \"0508a977-ea39-464c-9849-d051e7eb3b90\" (UID: \"0508a977-ea39-464c-9849-d051e7eb3b90\") "
Jul 08 21:49:32.624573 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.624548    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0508a977-ea39-464c-9849-d051e7eb3b90-kube-api-access-sfptm" (OuterVolumeSpecName: "kube-api-access-sfptm") pod "0508a977-ea39-464c-9849-d051e7eb3b90" (UID: "0508a977-ea39-464c-9849-d051e7eb3b90"). InnerVolumeSpecName "kube-api-access-sfptm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:32.696137 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.696096    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191916695216"]
Jul 08 21:49:32.696453 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.696440    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" containerName="test-curl-7802-140191913418288"
Jul 08 21:49:32.696508 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.696455    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" containerName="test-curl-7802-140191913418288"
Jul 08 21:49:32.696544 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.696523    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" containerName="test-curl-7802-140191913418288"
Jul 08 21:49:32.699423 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.699408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:32.705494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.705470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191916695216"]
Jul 08 21:49:32.723674 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.723648    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfptm\" (UniqueName: \"kubernetes.io/projected/0508a977-ea39-464c-9849-d051e7eb3b90-kube-api-access-sfptm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:32.824731 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.824694    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf69m\" (UniqueName: \"kubernetes.io/projected/aa9ee007-3394-4606-bd2b-4fea6f100f03-kube-api-access-lf69m\") pod \"test-curl-7802-140191916695216\" (UID: \"aa9ee007-3394-4606-bd2b-4fea6f100f03\") " pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:32.922190 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.922095    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h" podUID="3bf33b8c-483c-45a5-9ad1-09f813ab34f3" containerName="main" containerID="cri-o://30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87" gracePeriod=45
Jul 08 21:49:32.925864 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.925836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf69m\" (UniqueName: \"kubernetes.io/projected/aa9ee007-3394-4606-bd2b-4fea6f100f03-kube-api-access-lf69m\") pod \"test-curl-7802-140191916695216\" (UID: \"aa9ee007-3394-4606-bd2b-4fea6f100f03\") " pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:32.933958 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:32.933940    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf69m\" (UniqueName: \"kubernetes.io/projected/aa9ee007-3394-4606-bd2b-4fea6f100f03-kube-api-access-lf69m\") pod \"test-curl-7802-140191916695216\" (UID: \"aa9ee007-3394-4606-bd2b-4fea6f100f03\") " pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:33.008997 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.008941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:33.184644 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.184620    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:49:33.330067 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330034    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tls-certs\") pod \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") "
Jul 08 21:49:33.330240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330084    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-dshm\") pod \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") "
Jul 08 21:49:33.330240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330112    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-model-cache\") pod \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") "
Jul 08 21:49:33.330240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330161    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tmp-dir\") pod \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") "
Jul 08 21:49:33.330240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330190    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pq5lz\" (UniqueName: \"kubernetes.io/projected/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-kube-api-access-pq5lz\") pod \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") "
Jul 08 21:49:33.330240 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330212    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-home\") pod \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\" (UID: \"3bf33b8c-483c-45a5-9ad1-09f813ab34f3\") "
Jul 08 21:49:33.330520 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330499    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "3bf33b8c-483c-45a5-9ad1-09f813ab34f3" (UID: "3bf33b8c-483c-45a5-9ad1-09f813ab34f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:33.330622 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330597    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-home" (OuterVolumeSpecName: "home") pod "3bf33b8c-483c-45a5-9ad1-09f813ab34f3" (UID: "3bf33b8c-483c-45a5-9ad1-09f813ab34f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:33.330743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.330645    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3bf33b8c-483c-45a5-9ad1-09f813ab34f3" (UID: "3bf33b8c-483c-45a5-9ad1-09f813ab34f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:33.332635 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.332609    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3bf33b8c-483c-45a5-9ad1-09f813ab34f3" (UID: "3bf33b8c-483c-45a5-9ad1-09f813ab34f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:49:33.332740 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.332645    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-dshm" (OuterVolumeSpecName: "dshm") pod "3bf33b8c-483c-45a5-9ad1-09f813ab34f3" (UID: "3bf33b8c-483c-45a5-9ad1-09f813ab34f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:33.332740 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.332675    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-kube-api-access-pq5lz" (OuterVolumeSpecName: "kube-api-access-pq5lz") pod "3bf33b8c-483c-45a5-9ad1-09f813ab34f3" (UID: "3bf33b8c-483c-45a5-9ad1-09f813ab34f3"). InnerVolumeSpecName "kube-api-access-pq5lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:33.349897 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.349863    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191916695216"]
Jul 08 21:49:33.352092 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:49:33.352070    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa9ee007_3394_4606_bd2b_4fea6f100f03.slice/crio-6b4ad29a65d973fb40cf19a47c135c6d146a6867f248eb58fb77e250e19fbd94 WatchSource:0}: Error finding container 6b4ad29a65d973fb40cf19a47c135c6d146a6867f248eb58fb77e250e19fbd94: Status 404 returned error can't find the container with id 6b4ad29a65d973fb40cf19a47c135c6d146a6867f248eb58fb77e250e19fbd94
Jul 08 21:49:33.358598 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.358573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216" event={"ID":"aa9ee007-3394-4606-bd2b-4fea6f100f03","Type":"ContainerStarted","Data":"6b4ad29a65d973fb40cf19a47c135c6d146a6867f248eb58fb77e250e19fbd94"}
Jul 08 21:49:33.359712 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.359690    2560 generic.go:356] "Generic (PLEG): container finished" podID="3bf33b8c-483c-45a5-9ad1-09f813ab34f3" containerID="30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87" exitCode=0
Jul 08 21:49:33.359810 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.359733    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"
Jul 08 21:49:33.359810 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.359760    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h" event={"ID":"3bf33b8c-483c-45a5-9ad1-09f813ab34f3","Type":"ContainerDied","Data":"30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87"}
Jul 08 21:49:33.359810 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.359796    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h" event={"ID":"3bf33b8c-483c-45a5-9ad1-09f813ab34f3","Type":"ContainerDied","Data":"fb736fcdc6e6cd8ad1e77317e0a777cd8d7495f74e9bab65fdbf02816b1edc55"}
Jul 08 21:49:33.359946 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.359814    2560 scope.go:117] "RemoveContainer" containerID="30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87"
Jul 08 21:49:33.360983 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.360953    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:33.360983 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.360980    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ed211dfc72476efbdf2d0da177241da9e0d866352e27a199b024cbd71e8fe4b"
Jul 08 21:49:33.370070 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.370054    2560 scope.go:117] "RemoveContainer" containerID="30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87"
Jul 08 21:49:33.370325 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:49:33.370308    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87\": container with ID starting with 30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87 not found: ID does not exist" containerID="30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87"
Jul 08 21:49:33.370432 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.370332    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87"} err="failed to get container status \"30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87\": rpc error: code = NotFound desc = could not find container \"30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87\": container with ID starting with 30b560d2dc190826f5152e41a5f36ed1d194616e65f6108e8c32b197378f1b87 not found: ID does not exist"
Jul 08 21:49:33.384184 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.384162    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"]
Jul 08 21:49:33.389285 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:49:33.389260    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7802-140191913418288\" is forbidden: User \"system:node:ip-10-0-132-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-132-192.ec2.internal' and this object" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:33.389979 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.389959    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fbb91c/rate-test-model-fbb91c-kserve-644d487d47-hng9h"]
Jul 08 21:49:33.390966 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:49:33.390944    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7802-140191913418288\" is forbidden: User \"system:node:ip-10-0-132-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-132-192.ec2.internal' and this object" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:33.431265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.431187    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:33.431265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.431213    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:33.431265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.431222    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:33.431265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.431232    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:33.431265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.431240    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pq5lz\" (UniqueName: \"kubernetes.io/projected/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-kube-api-access-pq5lz\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:33.431265 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.431250    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf33b8c-483c-45a5-9ad1-09f813ab34f3-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:33.689032 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.688951    2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt" podUID="36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" containerName="main" containerID="cri-o://130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a" gracePeriod=45
Jul 08 21:49:33.933673 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:33.933649    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:49:33.952610 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:49:33.952538    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7802-140191913418288\" is forbidden: User \"system:node:ip-10-0-132-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-132-192.ec2.internal' and this object" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" pod="odh-ai-gateway-infra/test-curl-7802-140191913418288"
Jul 08 21:49:34.036312 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tls-certs\") pod \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") "
Jul 08 21:49:34.036312 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036313    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-model-cache\") pod \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") "
Jul 08 21:49:34.036600 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036354    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tmp-dir\") pod \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") "
Jul 08 21:49:34.036600 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036427    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-dshm\") pod \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") "
Jul 08 21:49:34.036600 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036443    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-home\") pod \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") "
Jul 08 21:49:34.036600 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036474    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgdp2\" (UniqueName: \"kubernetes.io/projected/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-kube-api-access-hgdp2\") pod \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\" (UID: \"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29\") "
Jul 08 21:49:34.036817 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036621    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-model-cache" (OuterVolumeSpecName: "model-cache") pod "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" (UID: "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:34.036817 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036657    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" (UID: "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:34.036817 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036745    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-home" (OuterVolumeSpecName: "home") pod "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" (UID: "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:34.036817 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036767    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-model-cache\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:34.036817 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.036787    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tmp-dir\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:34.038629 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.038601    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-dshm" (OuterVolumeSpecName: "dshm") pod "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" (UID: "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 21:49:34.038742 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.038640    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" (UID: "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 21:49:34.038742 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.038653    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-kube-api-access-hgdp2" (OuterVolumeSpecName: "kube-api-access-hgdp2") pod "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" (UID: "36d86f48-7e82-41a5-8e3e-5f7ec93f3a29"). InnerVolumeSpecName "kube-api-access-hgdp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:34.137152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.137122    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-tls-certs\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:34.137152 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.137152    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-dshm\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:34.137347 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.137163    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-home\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:34.137347 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.137175    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgdp2\" (UniqueName: \"kubernetes.io/projected/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29-kube-api-access-hgdp2\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:34.205552 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.205475    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0508a977-ea39-464c-9849-d051e7eb3b90" path="/var/lib/kubelet/pods/0508a977-ea39-464c-9849-d051e7eb3b90/volumes"
Jul 08 21:49:34.205885 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.205873    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf33b8c-483c-45a5-9ad1-09f813ab34f3" path="/var/lib/kubelet/pods/3bf33b8c-483c-45a5-9ad1-09f813ab34f3/volumes"
Jul 08 21:49:34.366589 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.366554    2560 generic.go:356] "Generic (PLEG): container finished" podID="36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" containerID="130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a" exitCode=0
Jul 08 21:49:34.366789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.366613    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"
Jul 08 21:49:34.366789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.366640    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt" event={"ID":"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29","Type":"ContainerDied","Data":"130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a"}
Jul 08 21:49:34.366789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.366685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt" event={"ID":"36d86f48-7e82-41a5-8e3e-5f7ec93f3a29","Type":"ContainerDied","Data":"91dae30188d5f61f1bba525d4803d00bf1116364dc16691760c0237331404c5c"}
Jul 08 21:49:34.366789 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.366709    2560 scope.go:117] "RemoveContainer" containerID="130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a"
Jul 08 21:49:34.368344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.368292    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216" event={"ID":"aa9ee007-3394-4606-bd2b-4fea6f100f03","Type":"ContainerStarted","Data":"dfa7b6ce606b042315a0be85bbd6c4e3101db2dd574c60577dbe59d9913323fa"}
Jul 08 21:49:34.375411 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.375390    2560 scope.go:117] "RemoveContainer" containerID="130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a"
Jul 08 21:49:34.375676 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:49:34.375654    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a\": container with ID starting with 130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a not found: ID does not exist" containerID="130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a"
Jul 08 21:49:34.375743 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.375686    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a"} err="failed to get container status \"130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a\": rpc error: code = NotFound desc = could not find container \"130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a\": container with ID starting with 130dfb17be3039059fdd39ca5411866c11945522cdae5d2ae85eef49f5cfde3a not found: ID does not exist"
Jul 08 21:49:34.381430 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.381407    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"]
Jul 08 21:49:34.383821 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.383796    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6edaf8/rate-test-model-6edaf8-kserve-7d7c9f6fcf-kgrzt"]
Jul 08 21:49:34.396528 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:34.396486    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216" podStartSLOduration=2.105101709 podStartE2EDuration="2.396474337s" totalImagesPullingTime="291.372628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:49:34.394530332 +0000 UTC m=+2612.646452534" watchObservedRunningTime="2026-07-08 21:49:34.396474337 +0000 UTC m=+2612.648396539"
Jul 08 21:49:36.205106 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:36.205074    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" path="/var/lib/kubelet/pods/36d86f48-7e82-41a5-8e3e-5f7ec93f3a29/volumes"
Jul 08 21:49:44.416358 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:44.416315    2560 generic.go:356] "Generic (PLEG): container finished" podID="aa9ee007-3394-4606-bd2b-4fea6f100f03" containerID="dfa7b6ce606b042315a0be85bbd6c4e3101db2dd574c60577dbe59d9913323fa" exitCode=28
Jul 08 21:49:44.416767 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:44.416391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216" event={"ID":"aa9ee007-3394-4606-bd2b-4fea6f100f03","Type":"ContainerDied","Data":"dfa7b6ce606b042315a0be85bbd6c4e3101db2dd574c60577dbe59d9913323fa"}
Jul 08 21:49:45.566702 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.566677    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:45.596728 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.596696    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191916695216"]
Jul 08 21:49:45.600381 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.600345    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191916695216"]
Jul 08 21:49:45.634522 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.634489    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf69m\" (UniqueName: \"kubernetes.io/projected/aa9ee007-3394-4606-bd2b-4fea6f100f03-kube-api-access-lf69m\") pod \"aa9ee007-3394-4606-bd2b-4fea6f100f03\" (UID: \"aa9ee007-3394-4606-bd2b-4fea6f100f03\") "
Jul 08 21:49:45.636553 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.636532    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa9ee007-3394-4606-bd2b-4fea6f100f03-kube-api-access-lf69m" (OuterVolumeSpecName: "kube-api-access-lf69m") pod "aa9ee007-3394-4606-bd2b-4fea6f100f03" (UID: "aa9ee007-3394-4606-bd2b-4fea6f100f03"). InnerVolumeSpecName "kube-api-access-lf69m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:45.735446 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.735331    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf69m\" (UniqueName: \"kubernetes.io/projected/aa9ee007-3394-4606-bd2b-4fea6f100f03-kube-api-access-lf69m\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:45.778140 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778106    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191917224992"]
Jul 08 21:49:45.778443 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778431    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf33b8c-483c-45a5-9ad1-09f813ab34f3" containerName="main"
Jul 08 21:49:45.778487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778445    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf33b8c-483c-45a5-9ad1-09f813ab34f3" containerName="main"
Jul 08 21:49:45.778487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778459    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa9ee007-3394-4606-bd2b-4fea6f100f03" containerName="test-curl-7802-140191916695216"
Jul 08 21:49:45.778487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778465    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa9ee007-3394-4606-bd2b-4fea6f100f03" containerName="test-curl-7802-140191916695216"
Jul 08 21:49:45.778487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778480    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" containerName="main"
Jul 08 21:49:45.778487 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778485    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" containerName="main"
Jul 08 21:49:45.778642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778536    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf33b8c-483c-45a5-9ad1-09f813ab34f3" containerName="main"
Jul 08 21:49:45.778642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778543    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="36d86f48-7e82-41a5-8e3e-5f7ec93f3a29" containerName="main"
Jul 08 21:49:45.778642 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.778552    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa9ee007-3394-4606-bd2b-4fea6f100f03" containerName="test-curl-7802-140191916695216"
Jul 08 21:49:45.781376 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.781350    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:45.784972 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.784944    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191917224992"]
Jul 08 21:49:45.936922 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:45.936876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxws5\" (UniqueName: \"kubernetes.io/projected/4a51cc67-c959-45c0-905b-0b899ace5602-kube-api-access-qxws5\") pod \"test-curl-7802-140191917224992\" (UID: \"4a51cc67-c959-45c0-905b-0b899ace5602\") " pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:46.037942 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.037855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxws5\" (UniqueName: \"kubernetes.io/projected/4a51cc67-c959-45c0-905b-0b899ace5602-kube-api-access-qxws5\") pod \"test-curl-7802-140191917224992\" (UID: \"4a51cc67-c959-45c0-905b-0b899ace5602\") " pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:46.045245 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.045210    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxws5\" (UniqueName: \"kubernetes.io/projected/4a51cc67-c959-45c0-905b-0b899ace5602-kube-api-access-qxws5\") pod \"test-curl-7802-140191917224992\" (UID: \"4a51cc67-c959-45c0-905b-0b899ace5602\") " pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:46.090887 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.090846    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:46.206100 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.206066    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa9ee007-3394-4606-bd2b-4fea6f100f03" path="/var/lib/kubelet/pods/aa9ee007-3394-4606-bd2b-4fea6f100f03/volumes"
Jul 08 21:49:46.218101 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.218079    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191917224992"]
Jul 08 21:49:46.220341 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:49:46.220319    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a51cc67_c959_45c0_905b_0b899ace5602.slice/crio-8333c54674dc87fa433db0d363b227b4288bc01d8a0ea8bc1e63f6ac358251e3 WatchSource:0}: Error finding container 8333c54674dc87fa433db0d363b227b4288bc01d8a0ea8bc1e63f6ac358251e3: Status 404 returned error can't find the container with id 8333c54674dc87fa433db0d363b227b4288bc01d8a0ea8bc1e63f6ac358251e3
Jul 08 21:49:46.426282 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.426245    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992" event={"ID":"4a51cc67-c959-45c0-905b-0b899ace5602","Type":"ContainerStarted","Data":"8333c54674dc87fa433db0d363b227b4288bc01d8a0ea8bc1e63f6ac358251e3"}
Jul 08 21:49:46.427539 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.427522    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191916695216"
Jul 08 21:49:46.427699 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:46.427538    2560 scope.go:117] "RemoveContainer" containerID="dfa7b6ce606b042315a0be85bbd6c4e3101db2dd574c60577dbe59d9913323fa"
Jul 08 21:49:47.435398 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:47.435349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992" event={"ID":"4a51cc67-c959-45c0-905b-0b899ace5602","Type":"ContainerStarted","Data":"671e4f6d3aba37250c1d50614d2b15486686e106f8e5efecf84a8c072edd2b1e"}
Jul 08 21:49:47.450727 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:47.450670    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992" podStartSLOduration=2.157668644 podStartE2EDuration="2.450650964s" totalImagesPullingTime="292.98232ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:49:47.448668538 +0000 UTC m=+2625.700590769" watchObservedRunningTime="2026-07-08 21:49:47.450650964 +0000 UTC m=+2625.702573204"
Jul 08 21:49:57.484550 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:57.484513    2560 generic.go:356] "Generic (PLEG): container finished" podID="4a51cc67-c959-45c0-905b-0b899ace5602" containerID="671e4f6d3aba37250c1d50614d2b15486686e106f8e5efecf84a8c072edd2b1e" exitCode=28
Jul 08 21:49:57.484972 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:57.484560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992" event={"ID":"4a51cc67-c959-45c0-905b-0b899ace5602","Type":"ContainerDied","Data":"671e4f6d3aba37250c1d50614d2b15486686e106f8e5efecf84a8c072edd2b1e"}
Jul 08 21:49:58.621317 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:58.621292    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:58.650695 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:58.650659    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191917224992"]
Jul 08 21:49:58.654462 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:58.654438    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7802-140191917224992"]
Jul 08 21:49:58.758756 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:58.758679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxws5\" (UniqueName: \"kubernetes.io/projected/4a51cc67-c959-45c0-905b-0b899ace5602-kube-api-access-qxws5\") pod \"4a51cc67-c959-45c0-905b-0b899ace5602\" (UID: \"4a51cc67-c959-45c0-905b-0b899ace5602\") "
Jul 08 21:49:58.760657 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:58.760627    2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a51cc67-c959-45c0-905b-0b899ace5602-kube-api-access-qxws5" (OuterVolumeSpecName: "kube-api-access-qxws5") pod "4a51cc67-c959-45c0-905b-0b899ace5602" (UID: "4a51cc67-c959-45c0-905b-0b899ace5602"). InnerVolumeSpecName "kube-api-access-qxws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 21:49:58.860090 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:58.860056    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxws5\" (UniqueName: \"kubernetes.io/projected/4a51cc67-c959-45c0-905b-0b899ace5602-kube-api-access-qxws5\") on node \"ip-10-0-132-192.ec2.internal\" DevicePath \"\""
Jul 08 21:49:59.495192 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:59.495159    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:49:59.495390 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:49:59.495161    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8333c54674dc87fa433db0d363b227b4288bc01d8a0ea8bc1e63f6ac358251e3"
Jul 08 21:49:59.506721 ip-10-0-132-192 kubenswrapper[2560]: E0708 21:49:59.506684    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7802-140191917224992\" is forbidden: User \"system:node:ip-10-0-132-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-132-192.ec2.internal' and this object" podUID="4a51cc67-c959-45c0-905b-0b899ace5602" pod="odh-ai-gateway-infra/test-curl-7802-140191917224992"
Jul 08 21:50:00.205610 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:00.205576    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a51cc67-c959-45c0-905b-0b899ace5602" path="/var/lib/kubelet/pods/4a51cc67-c959-45c0-905b-0b899ace5602/volumes"
Jul 08 21:50:03.184873 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:03.184834    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:50:13.374903 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:13.374862    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-596fcc8767-n7nfk_1f09b0f4-6694-4fff-8338-c41cf90caf61/authorino/0.log"
Jul 08 21:50:15.381913 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:15.381880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-p558z"]
Jul 08 21:50:18.427388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:18.427333    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ptnzp_caa5d730-885a-4521-8bc4-a205cca21a33/manager/0.log"
Jul 08 21:50:19.233759 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:19.233731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-v9r46_49f3e879-ff31-4d80-9355-2a13164b84f6/copy-manifests/0.log"
Jul 08 21:50:19.240776 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:19.240751    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-v9r46_49f3e879-ff31-4d80-9355-2a13164b84f6/manager/0.log"
Jul 08 21:50:20.210386 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:20.210337    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm_41adf124-085a-43d5-a633-2c2e439cadd6/util/0.log"
Jul 08 21:50:20.216481 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:20.216459    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm_41adf124-085a-43d5-a633-2c2e439cadd6/pull/0.log"
Jul 08 21:50:20.222203 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:20.222184    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm_41adf124-085a-43d5-a633-2c2e439cadd6/extract/0.log"
Jul 08 21:50:20.642344 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:20.642319    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-596fcc8767-n7nfk_1f09b0f4-6694-4fff-8338-c41cf90caf61/authorino/0.log"
Jul 08 21:50:21.404634 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:21.404601    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-p558z_bddfa682-ac97-47f9-937e-b3f089d1e225/limitador/0.log"
Jul 08 21:50:22.176337 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:22.176305    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7c4b48c4-hpzcf_5a2c001d-5073-4744-b239-eb76e8399968/kube-auth-proxy/0.log"
Jul 08 21:50:22.814013 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:22.813980    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5989d4555-zt8h6_41ccbe14-5f86-4d32-9542-70effc085712/router/0.log"
Jul 08 21:50:23.807030 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:23.806994    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-vcrck_5f267027-ddd3-4e9a-83cf-8434f2c77bb7/main/0.log"
Jul 08 21:50:28.330338 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.330298    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntfkr/must-gather-txl9s"]
Jul 08 21:50:28.330909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.330657    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a51cc67-c959-45c0-905b-0b899ace5602" containerName="test-curl-7802-140191917224992"
Jul 08 21:50:28.330909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.330670    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a51cc67-c959-45c0-905b-0b899ace5602" containerName="test-curl-7802-140191917224992"
Jul 08 21:50:28.330909 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.330753    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a51cc67-c959-45c0-905b-0b899ace5602" containerName="test-curl-7802-140191917224992"
Jul 08 21:50:28.334036 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.334019    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.337449 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.337417    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntfkr\"/\"openshift-service-ca.crt\""
Jul 08 21:50:28.337449 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.337416    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ntfkr\"/\"default-dockercfg-hzz45\""
Jul 08 21:50:28.337646 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.337548    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ntfkr\"/\"kube-root-ca.crt\""
Jul 08 21:50:28.343475 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.343452    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntfkr/must-gather-txl9s"]
Jul 08 21:50:28.347511 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.347489    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmh92\" (UniqueName: \"kubernetes.io/projected/2b6f1e65-d774-4634-92bd-87857be4cf13-kube-api-access-nmh92\") pod \"must-gather-txl9s\" (UID: \"2b6f1e65-d774-4634-92bd-87857be4cf13\") " pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.347636 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.347548    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b6f1e65-d774-4634-92bd-87857be4cf13-must-gather-output\") pod \"must-gather-txl9s\" (UID: \"2b6f1e65-d774-4634-92bd-87857be4cf13\") " pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.448083 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.448038    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b6f1e65-d774-4634-92bd-87857be4cf13-must-gather-output\") pod \"must-gather-txl9s\" (UID: \"2b6f1e65-d774-4634-92bd-87857be4cf13\") " pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.448284 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.448130    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmh92\" (UniqueName: \"kubernetes.io/projected/2b6f1e65-d774-4634-92bd-87857be4cf13-kube-api-access-nmh92\") pod \"must-gather-txl9s\" (UID: \"2b6f1e65-d774-4634-92bd-87857be4cf13\") " pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.448427 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.448405    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2b6f1e65-d774-4634-92bd-87857be4cf13-must-gather-output\") pod \"must-gather-txl9s\" (UID: \"2b6f1e65-d774-4634-92bd-87857be4cf13\") " pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.456635 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.456610    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmh92\" (UniqueName: \"kubernetes.io/projected/2b6f1e65-d774-4634-92bd-87857be4cf13-kube-api-access-nmh92\") pod \"must-gather-txl9s\" (UID: \"2b6f1e65-d774-4634-92bd-87857be4cf13\") " pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.644537 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.644508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntfkr/must-gather-txl9s"
Jul 08 21:50:28.777508 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:28.777483    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntfkr/must-gather-txl9s"]
Jul 08 21:50:28.779541 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:50:28.779510    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b6f1e65_d774_4634_92bd_87857be4cf13.slice/crio-5aa2ad66f2543dc0ea19b5173b9e46bf356edb0dfd68aefd428385f8f6809d1c WatchSource:0}: Error finding container 5aa2ad66f2543dc0ea19b5173b9e46bf356edb0dfd68aefd428385f8f6809d1c: Status 404 returned error can't find the container with id 5aa2ad66f2543dc0ea19b5173b9e46bf356edb0dfd68aefd428385f8f6809d1c
Jul 08 21:50:29.633249 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:29.633221    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/must-gather-txl9s" event={"ID":"2b6f1e65-d774-4634-92bd-87857be4cf13","Type":"ContainerStarted","Data":"5aa2ad66f2543dc0ea19b5173b9e46bf356edb0dfd68aefd428385f8f6809d1c"}
Jul 08 21:50:30.642857 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:30.642811    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/must-gather-txl9s" event={"ID":"2b6f1e65-d774-4634-92bd-87857be4cf13","Type":"ContainerStarted","Data":"156d54d9529c350f6a0f25e27f42271eae25f7d737ce626bfb55bfa104799c6b"}
Jul 08 21:50:30.642857 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:30.642859    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/must-gather-txl9s" event={"ID":"2b6f1e65-d774-4634-92bd-87857be4cf13","Type":"ContainerStarted","Data":"6f18caad8d0602d182a7cb21b4d5d51c8495c43b40f0107e59f046a3bcb7a7e8"}
Jul 08 21:50:30.658199 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:30.658151    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ntfkr/must-gather-txl9s" podStartSLOduration=1.809923279 podStartE2EDuration="2.658133814s" totalImagesPullingTime="848.210535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 21:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:50:30.657127604 +0000 UTC m=+2668.909049807" watchObservedRunningTime="2026-07-08 21:50:30.658133814 +0000 UTC m=+2668.910056057"
Jul 08 21:50:31.217524 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:31.217481    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b62pz_bb148e1a-fbe6-44da-b3f1-b542e6f57fca/global-pull-secret-syncer/0.log"
Jul 08 21:50:31.312852 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:31.312818    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fskxt_df3b458c-f93d-4ba0-a91c-fa1c90eb631c/konnectivity-agent/0.log"
Jul 08 21:50:31.390045 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:31.390015    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-192.ec2.internal_07d1f4d49abf1d7933a9ae700ae56fff/haproxy/0.log"
Jul 08 21:50:35.701281 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:35.701211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm_41adf124-085a-43d5-a633-2c2e439cadd6/extract/0.log"
Jul 08 21:50:35.728470 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:35.728437    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm_41adf124-085a-43d5-a633-2c2e439cadd6/util/0.log"
Jul 08 21:50:35.756141 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:35.754387    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e09f6wm_41adf124-085a-43d5-a633-2c2e439cadd6/pull/0.log"
Jul 08 21:50:36.402076 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:36.402035    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-596fcc8767-n7nfk_1f09b0f4-6694-4fff-8338-c41cf90caf61/authorino/0.log"
Jul 08 21:50:36.724815 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:36.724738    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-p558z_bddfa682-ac97-47f9-937e-b3f089d1e225/limitador/0.log"
Jul 08 21:50:38.822975 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:38.822873    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-lr9c9_2377154d-3bca-4f12-a1c5-daf75e539f27/cluster-monitoring-operator/0.log"
Jul 08 21:50:39.155974 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:39.155934    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfgmn_2ba28274-0d75-44ae-917c-0b3853be631e/node-exporter/0.log"
Jul 08 21:50:39.179455 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:39.179408    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfgmn_2ba28274-0d75-44ae-917c-0b3853be631e/kube-rbac-proxy/0.log"
Jul 08 21:50:39.201010 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:39.200983    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfgmn_2ba28274-0d75-44ae-917c-0b3853be631e/init-textfile/0.log"
Jul 08 21:50:39.228182 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:39.228153    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-6vqwr_e29d9cdb-1f67-4419-97e7-44d951dbecbf/kube-rbac-proxy-main/0.log"
Jul 08 21:50:39.250144 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:39.250110    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-6vqwr_e29d9cdb-1f67-4419-97e7-44d951dbecbf/kube-rbac-proxy-self/0.log"
Jul 08 21:50:39.273211 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:39.273183    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-6vqwr_e29d9cdb-1f67-4419-97e7-44d951dbecbf/openshift-state-metrics/0.log"
Jul 08 21:50:41.637225 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.637189    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"]
Jul 08 21:50:41.641166 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.641139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.652794 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.652766    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"]
Jul 08 21:50:41.677388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.676649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-proc\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.677388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.676733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljgn\" (UniqueName: \"kubernetes.io/projected/e6e0f3b4-9490-4e77-988c-a2066858c48a-kube-api-access-8ljgn\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.677388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.676764    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-podres\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.677388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.676789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-sys\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.677388 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.676827    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-lib-modules\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.777846 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.777807    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-proc\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.777872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljgn\" (UniqueName: \"kubernetes.io/projected/e6e0f3b4-9490-4e77-988c-a2066858c48a-kube-api-access-8ljgn\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.777898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-podres\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.777916    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-sys\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.777940    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-proc\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778028 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.777980    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-sys\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.778068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-lib-modules\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.778073    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-podres\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.778298 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.778181    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6e0f3b4-9490-4e77-988c-a2066858c48a-lib-modules\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.786258 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.786224    2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljgn\" (UniqueName: \"kubernetes.io/projected/e6e0f3b4-9490-4e77-988c-a2066858c48a-kube-api-access-8ljgn\") pod \"perf-node-gather-daemonset-dsdsb\" (UID: \"e6e0f3b4-9490-4e77-988c-a2066858c48a\") " pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:41.956230 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:41.956138    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:42.142589 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:42.142438    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"]
Jul 08 21:50:42.145307 ip-10-0-132-192 kubenswrapper[2560]: W0708 21:50:42.145272    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6e0f3b4_9490_4e77_988c_a2066858c48a.slice/crio-ab9a21e783fdab91298144664214be91aa614bb2c2b1a126876a127ad4958ea4 WatchSource:0}: Error finding container ab9a21e783fdab91298144664214be91aa614bb2c2b1a126876a127ad4958ea4: Status 404 returned error can't find the container with id ab9a21e783fdab91298144664214be91aa614bb2c2b1a126876a127ad4958ea4
Jul 08 21:50:42.751609 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:42.751573    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb" event={"ID":"e6e0f3b4-9490-4e77-988c-a2066858c48a","Type":"ContainerStarted","Data":"c997c27c8e4755125f025efed1119603daf22bde63fbd56839b90227d1f1b64d"}
Jul 08 21:50:42.752060 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:42.751631    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb" event={"ID":"e6e0f3b4-9490-4e77-988c-a2066858c48a","Type":"ContainerStarted","Data":"ab9a21e783fdab91298144664214be91aa614bb2c2b1a126876a127ad4958ea4"}
Jul 08 21:50:42.752060 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:42.751659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:42.774484 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:42.774433    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb" podStartSLOduration=1.774416596 podStartE2EDuration="1.774416596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 21:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 21:50:42.772523577 +0000 UTC m=+2681.024445781" watchObservedRunningTime="2026-07-08 21:50:42.774416596 +0000 UTC m=+2681.026338798"
Jul 08 21:50:43.898857 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:43.898826    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7t2x7_4cfb69ae-b74c-400c-a273-35b9927a0142/dns/0.log"
Jul 08 21:50:43.927829 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:43.927783    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7t2x7_4cfb69ae-b74c-400c-a273-35b9927a0142/kube-rbac-proxy/0.log"
Jul 08 21:50:44.040484 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:44.040457    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6f5p2_f6615206-7688-4b36-a589-82299a33b18c/dns-node-resolver/0.log"
Jul 08 21:50:44.629753 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:44.629723    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b4c974bdb-cckw7_875075ab-ca56-4e50-9276-c8b9ec4c05f5/registry/0.log"
Jul 08 21:50:44.649062 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:44.649031    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b4c974bdb-cckw7_875075ab-ca56-4e50-9276-c8b9ec4c05f5/registry/1.log"
Jul 08 21:50:44.719757 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:44.719729    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sd2bb_a236567e-f033-45c4-b129-0c0018534103/node-ca/0.log"
Jul 08 21:50:45.769631 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:45.769603    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7c4b48c4-hpzcf_5a2c001d-5073-4744-b239-eb76e8399968/kube-auth-proxy/0.log"
Jul 08 21:50:45.990142 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:45.990107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5989d4555-zt8h6_41ccbe14-5f86-4d32-9542-70effc085712/router/0.log"
Jul 08 21:50:46.713939 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:46.713913    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gvwfb_73cb0101-875e-4108-b4dd-d9618bcfd9ce/serve-healthcheck-canary/0.log"
Jul 08 21:50:47.218150 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:47.218115    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qtkf_ca636af6-c2a3-4206-afd3-36538340c976/kube-rbac-proxy/0.log"
Jul 08 21:50:47.240708 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:47.240678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qtkf_ca636af6-c2a3-4206-afd3-36538340c976/exporter/0.log"
Jul 08 21:50:47.261007 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:47.260978    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8qtkf_ca636af6-c2a3-4206-afd3-36538340c976/extractor/0.log"
Jul 08 21:50:48.768212 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:48.768187    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ntfkr/perf-node-gather-daemonset-dsdsb"
Jul 08 21:50:49.798956 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:49.798927    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ptnzp_caa5d730-885a-4521-8bc4-a205cca21a33/manager/0.log"
Jul 08 21:50:50.231702 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:50.231666    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-v9r46_49f3e879-ff31-4d80-9355-2a13164b84f6/manager/0.log"
Jul 08 21:50:50.253378 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:50.253336    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94bc986b9-v9r46_49f3e879-ff31-4d80-9355-2a13164b84f6/copy-manifests/0.log"
Jul 08 21:50:51.622861 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:51.622774    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66869b5f86-wf6gz_2aa36f98-5f3f-44dd-9e7c-b2f9839efb33/manager/0.log"
Jul 08 21:50:52.014170 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:52.014093    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7c4b48c4-hpzcf_5a2c001d-5073-4744-b239-eb76e8399968/kube-auth-proxy/0.log"
Jul 08 21:50:52.182185 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:52.182129    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5989d4555-zt8h6_41ccbe14-5f86-4d32-9542-70effc085712/router/0.log"
Jul 08 21:50:53.473218 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:53.473142    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7c4b48c4-hpzcf_5a2c001d-5073-4744-b239-eb76e8399968/kube-auth-proxy/0.log"
Jul 08 21:50:53.661291 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:53.661228    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5989d4555-zt8h6_41ccbe14-5f86-4d32-9542-70effc085712/router/0.log"
Jul 08 21:50:58.008722 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.008690    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2tx7p_c60e3aca-7b31-4ed5-a167-a7c6401248a6/kube-multus/0.log"
Jul 08 21:50:58.176494 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.176468    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/kube-multus-additional-cni-plugins/0.log"
Jul 08 21:50:58.198499 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.198474    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/egress-router-binary-copy/0.log"
Jul 08 21:50:58.225178 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.225154    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/cni-plugins/0.log"
Jul 08 21:50:58.244865 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.244837    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/bond-cni-plugin/0.log"
Jul 08 21:50:58.263646 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.263556    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/routeoverride-cni/0.log"
Jul 08 21:50:58.282923 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.282899    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/whereabouts-cni-bincopy/0.log"
Jul 08 21:50:58.301879 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.301855    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dq52g_a35f8a41-02b3-483f-966f-059027f264be/whereabouts-cni/0.log"
Jul 08 21:50:58.560585 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.560499    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rnk9k_a19b781d-37ae-40b6-b470-992503443eba/network-metrics-daemon/0.log"
Jul 08 21:50:58.582046 ip-10-0-132-192 kubenswrapper[2560]: I0708 21:50:58.582016    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rnk9k_a19b781d-37ae-40b6-b470-992503443eba/kube-rbac-proxy/0.log"